IST Austria Distributed Algorithms and Systems Lab

university

https://ist.ac.at/en/research/alistarh-group/

https://github.com/IST-DASLab

AI & ML interests

None defined yet.

Recent Activity

BlackSamorez authored a paper 1 day ago

Quartet II: Accurate LLM Pre-Training in NVFP4 by Improved Unbiased Gradient Estimation

soroushtabesh authored a paper 1 day ago

Quartet II: Accurate LLM Pre-Training in NVFP4 by Improved Unbiased Gradient Estimation

BlackSamorez submitted a paper 1 day ago

Quartet II: Accurate LLM Pre-Training in NVFP4 by Improved Unbiased Gradient Estimation

View all activity

Papers

Quartet II: Accurate LLM Pre-Training in NVFP4 by Improved Unbiased Gradient Estimation

WUSH: Near-Optimal Adaptive Transforms for LLM Quantization

View all Papers

ISTA-DASLab 's models 147

ISTA-DASLab/Mistral-7B-v0.1-AQLM-PV-2Bit-1x16-hf

Text Generation • 1B • Updated May 30, 2024 • 1

ISTA-DASLab/SOLAR-10.7B-Instruct-v1.0-GPTQ-4bit

Text Generation • 11B • Updated May 20, 2024

ISTA-DASLab/Llama-3-8B-Instruct-GPTQ-4bit

Text Generation • 8B • Updated May 16, 2024 • 1

ISTA-DASLab/Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16

Text Generation • 11B • Updated May 13, 2024 • 16 • 20

ISTA-DASLab/Phi-3-mini-4k-instruct-AQLM-1x16

Text Generation • 0.7B • Updated May 8, 2024 • 2

ISTA-DASLab/Phi-3-mini-128k-instruct-AQLM-1x16

Text Generation • 0.7B • Updated May 8, 2024 • 8 • 1

ISTA-DASLab/Meta-Llama-3-70B-AQLM-2Bit-1x16

Text Generation • 11B • Updated May 4, 2024 • 12 • 14

ISTA-DASLab/Meta-Llama-3-8B-Instruct

Text Generation • 8B • Updated Apr 23, 2024 • 5

ISTA-DASLab/c4ai-command-r-plus-AQLM-2Bit-1x16

Text Generation • 16B • Updated Apr 21, 2024 • 9 • 10

ISTA-DASLab/Mistral-7B-Instruct-v0.2-AQLM-2Bit-2x8

Text Generation • 2B • Updated Apr 13, 2024 • 73 • 3

ISTA-DASLab/c4ai-command-r-v01-AQLM-2Bit-1x16

Text Generation • 6B • Updated Apr 13, 2024 • 5 • 10

ISTA-DASLab/Mistral-7B-v0.1-AQLM-2Bit-1x16-hf

Text Generation • 1B • Updated Mar 11, 2024 • 23 • 2

ISTA-DASLab/Llama-2-70b-AQLM-2Bit-2x8-hf

Text Generation • 18B • Updated Mar 11, 2024 • 16 • 1

ISTA-DASLab/Llama-2-70b-AQLM-2Bit-1x16-hf

Text Generation • 9B • Updated Mar 11, 2024 • 23 • 6

ISTA-DASLab/Llama-2-13b-AQLM-2Bit-1x16-hf

Text Generation • 2B • Updated Mar 11, 2024 • 28

ISTA-DASLab/Llama-2-7b-AQLM-2Bit-8x8-hf

Text Generation • 2B • Updated Mar 11, 2024 • 13

ISTA-DASLab/Llama-2-7b-AQLM-2Bit-2x8-hf

Text Generation • 2B • Updated Mar 11, 2024 • 127 • 2

ISTA-DASLab/Llama-2-7b-AQLM-2Bit-1x16-hf

Text Generation • 1B • Updated Mar 11, 2024 • 79 • 5

ISTA-DASLab/Mixtral-8x7b-AQLM-2Bit-1x16-hf

Text Generation • 7B • Updated Mar 11, 2024 • 72 • 23

ISTA-DASLab/gemma-2b-AQLM-2Bit-2x8-hf

Text Generation • 1B • Updated Mar 10, 2024 • 16 • 4

ISTA-DASLab/gemma-2b-AQLM-2Bit-1x16-hf

Text Generation • 0.8B • Updated Mar 10, 2024 • 9 • 6

ISTA-DASLab/Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf

Text Generation • 7B • Updated Feb 27, 2024 • 20 • 18

ISTA-DASLab/Llama-2-13b-AQLM-4Bit-2x16-hf

Text Generation • Updated Feb 10, 2024 • 13

ISTA-DASLab/Llama-2-70b-AQLM-4Bit-2x16-hf

Text Generation • 18B • Updated Feb 10, 2024 • 11

ISTA-DASLab/switch-c-2048_qmoe

Updated Oct 25, 2023 • 1 • 4

ISTA-DASLab/switch-large-128_qmoe

Updated Oct 25, 2023 • 2

ISTA-DASLab/switch-base-128_qmoe

Updated Oct 25, 2023 • 4 • 1