Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

kv-cache-quantization

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

285

Base only

Active filters: kv-cache-quantization

majentik/gemma-4-31B-it-RotorQuant-GGUF-Q3_K_M

Image-Text-to-Text • 31B • Updated May 6 • 65

majentik/gemma-4-31B-it-RotorQuant-GGUF-Q2_K

Image-Text-to-Text • 31B • Updated May 6 • 92

majentik/gemma-4-31B-it-RotorQuant-GGUF-IQ4_XS

Image-Text-to-Text • 31B • Updated May 6 • 95

majentik/gemma-4-E2B-RotorQuant-GGUF-Q4_K_M

Image-Text-to-Text • 5B • Updated May 6 • 303 • 1

majentik/gemma-4-E2B-RotorQuant-GGUF-Q5_K_M

Image-Text-to-Text • 5B • Updated May 6 • 111

majentik/gemma-4-E2B-RotorQuant-GGUF-Q8_0

Image-Text-to-Text • 5B • Updated May 6 • 139 • 1

majentik/gemma-4-E2B-RotorQuant-GGUF-Q3_K_M

Image-Text-to-Text • 5B • Updated May 6 • 109

majentik/gemma-4-E2B-RotorQuant-GGUF-Q2_K

Image-Text-to-Text • 5B • Updated May 6 • 133

majentik/gemma-4-E2B-RotorQuant-GGUF-IQ4_XS

Image-Text-to-Text • 5B • Updated May 6 • 277

majentik/gemma-4-E2B-it-RotorQuant-GGUF-Q4_K_M

Image-Text-to-Text • 5B • Updated May 6 • 1.36k • 2

majentik/gemma-4-E2B-it-RotorQuant-GGUF-Q5_K_M

Image-Text-to-Text • 5B • Updated May 6 • 189 • 2

majentik/gemma-4-E2B-it-RotorQuant-GGUF-Q8_0

Image-Text-to-Text • 5B • Updated May 6 • 123 • 2

majentik/gemma-4-E2B-it-RotorQuant-GGUF-Q3_K_M

Image-Text-to-Text • 5B • Updated May 6 • 126

majentik/gemma-4-E2B-it-RotorQuant-GGUF-Q2_K

Image-Text-to-Text • 5B • Updated May 6 • 119

majentik/gemma-4-E2B-it-RotorQuant-GGUF-IQ4_XS

Image-Text-to-Text • 5B • Updated May 6 • 255 • 1

majentik/gemma-4-E4B-RotorQuant-GGUF-Q4_K_M

Image-Text-to-Text • 8B • Updated May 6 • 338 • 1

majentik/gemma-4-E4B-RotorQuant-GGUF-Q5_K_M

Image-Text-to-Text • 8B • Updated May 6 • 131

majentik/gemma-4-E4B-RotorQuant-GGUF-Q8_0

Image-Text-to-Text • 8B • Updated May 6 • 143

majentik/gemma-4-E4B-RotorQuant-GGUF-Q3_K_M

Image-Text-to-Text • 8B • Updated May 6 • 120

majentik/gemma-4-E4B-RotorQuant-GGUF-Q2_K

Image-Text-to-Text • 8B • Updated May 6 • 106

majentik/gemma-4-E4B-RotorQuant-GGUF-IQ4_XS

Image-Text-to-Text • 8B • Updated May 6 • 175

majentik/Qwen3.5-27B-RotorQuant-GGUF-Q4_K_M

Text Generation • 27B • Updated May 6 • 47

majentik/Qwen3.5-27B-RotorQuant-GGUF-Q5_K_M

Text Generation • 27B • Updated May 6 • 21

majentik/Qwen3.5-27B-RotorQuant-GGUF-Q8_0

Text Generation • 27B • Updated May 6 • 3

majentik/Qwen3.5-27B-RotorQuant-GGUF-Q3_K_M

Text Generation • 27B • Updated May 6 • 40

majentik/Qwen3.5-27B-RotorQuant-GGUF-Q2_K

Text Generation • 27B • Updated May 6 • 30 • 2

majentik/Qwen3.5-27B-RotorQuant-GGUF-IQ4_XS

Text Generation • 27B • Updated May 6 • 37

majentik/gemma-4-26B-A4B-it-RotorQuant-GGUF-Q4_K_M

Image-Text-to-Text • 25B • Updated May 6 • 427 • 1

majentik/gemma-4-26B-A4B-it-RotorQuant-GGUF-Q5_K_M

Image-Text-to-Text • 25B • Updated May 6 • 90

majentik/gemma-4-26B-A4B-it-RotorQuant-GGUF-Q8_0

Image-Text-to-Text • 25B • Updated May 6 • 454