Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

IST Austria Distributed Algorithms and Systems Lab

university
https://ist.ac.at/en/research/alistarh-group/
https://github.com/IST-DASLab
Activity Feed

AI & ML interests

None defined yet.

Recent Activity

SpiridonSunRotator  authored a paper 14 days ago
FLAMIA: FLAsh MIcroscaling Attention for Fast and Causally Safe Training on Blackwell
SpiridonSunRotator  submitted a paper 14 days ago
FLAMIA: FLAsh MIcroscaling Attention for Fast and Causally Safe Training on Blackwell
kwanhee  new activity 14 days ago
ISTA-DASLab/Kimi-K3-P48NVFP4-MoESQ:Kimi K3 GSQ-RCO-GGUF IQ1_S, IQ1_M, IQ2_XXS
View all activity

Papers

Hardware-Native Joint Sparse-Quantization for Trillion-Scale Mixture-of-Experts

WUSH-KV: KV Cache Quantization with Data-Adaptive Transforms

View all Papers

Eldar Kurtić's profile picture Denis Kuznedelev's profile picture Ionut Modoranu's profile picture Rush Tabesh's profile picture Eugenia Iofinova's profile picture Dan Alistarh's profile picture Elias Frantar's profile picture Alistarh's profile picture Andrei Panferov's profile picture amir moeini's profile picture Vladimir's profile picture Yozh's profile picture Jiale Chen's profile picture Tommaso Pegolotti's profile picture Vahe's profile picture Michael Helcig's profile picture Max Kleinegger's profile picture Alireza Dadgarnia's profile picture Kwanhee Lee's profile picture
ISTA-DASLab 's papers 17
Submitted by
Jiale Chen
42

The Geometry of LLM Quantization: GPTQ as Babai's Nearest Plane Algorithm

ISTA-DASLab IST Austria Distributed Algorithms and Systems Lab
13 3
Submitted by
Andrei Panferov
81

Quartet: Native FP4 Training Can Be Optimal for Large Language Models

ISTA-DASLab IST Austria Distributed Algorithms and Systems Lab
130 2
Submitted by
Alistarh
48

QuEST: Stable Training of LLMs with 1-Bit Weights and Activations

ISTA-DASLab IST Austria Distributed Algorithms and Systems Lab
82 3
3

Scalable Mechanistic Neural Networks

ISTA-DASLab IST Austria Distributed Algorithms and Systems Lab
2
4

MARLIN: Mixed-Precision Auto-Regressive Parallel Inference on Large Language Models

ISTA-DASLab IST Austria Distributed Algorithms and Systems Lab
1.18k
  • Previous
  • 1
  • 2
  • Next
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs