Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,885

Base only

Active filters: quantization

donghyunli/Meta-Llama-3-70B-KronQ-W2A16

Text Generation • 19B • Updated 5 days ago

donghyunli/Llama-2-70b-KronQ-W3A16-fake

Text Generation • 69B • Updated 5 days ago • 29

donghyunli/Meta-Llama-3-70B-KronQ-W3A16-fake

Text Generation • 71B • Updated 5 days ago • 29

JasonW2025/Nemotron-3-Nano-30B-A3B-NVFP4-AWQ

Text Generation • 18B • Updated 11 days ago • 10

kvignesh/phi4-mini-q8_0-gguf

Text Generation • 4B • Updated 11 days ago • 66 • 1

anoopbhargavakm87/Meta-Llama-3-8B-Instruct-4bit-Compressed

Text Generation • 8B • Updated 10 days ago • 27

tooltd/Qwen3.6-27B-AutoRound-GGUF-NoMTP

27B • Updated 8 days ago • 286 • 1

xv0y5ncu/gemma-4-12B-it-GLQ-3bpw-e8p-bd

Image-Text-to-Text • 2B • Updated 9 days ago • 133

ShockleyWong/gemma4-e2b-rdk-s100p

Image-Text-to-Text • Updated 10 days ago

nameistoken/Step-3.7-Flash-Quark-W4A16

Image-Text-to-Text • 203B • Updated 10 days ago • 840

nameistoken/Step-3.7-Flash-Quark-W8A8

Image-Text-to-Text • 201B • Updated 10 days ago • 21

Abhimanue/TCompress

0.1B • Updated 10 days ago

Fredred89/Qwopus3.6-27B-Coder-GGUF-kaitchup-MoQ-4.0

Updated 9 days ago

Fredred89/Qwopus3.6-27B-Coder-GGUF-ASI-MoQ-4.0

Updated 9 days ago

donghyunli/Llama-2-7b-KronQ-W4A16-g128

Text Generation • 4B • Updated 5 days ago • 24

donghyunli/Llama-2-7b-KronQ-W2A16-g128

Text Generation • 2B • Updated 5 days ago • 30

donghyunli/Meta-Llama-3-8B-KronQ-W4A16-g128

Text Generation • 5B • Updated 5 days ago • 30

donghyunli/Meta-Llama-3-8B-KronQ-W2A16-g128

Text Generation • 3B • Updated 5 days ago • 27

donghyunli/Llama-2-13b-KronQ-W4A16-g128

Text Generation • 7B • Updated 5 days ago • 25

donghyunli/Llama-2-70b-KronQ-W4A16-g128

Text Generation • 36B • Updated 5 days ago • 30

donghyunli/Llama-2-13b-KronQ-W2A16-g128

Text Generation • 4B • Updated 5 days ago • 25

donghyunli/Llama-2-7b-KronQ-W3A16-g128-fake

Text Generation • 7B • Updated 5 days ago • 30

donghyunli/Meta-Llama-3-8B-KronQ-W3A16-g128-fake

Text Generation • 8B • Updated 5 days ago • 29

donghyunli/Llama-2-70b-KronQ-W2A16-g128

Text Generation • 19B • Updated 5 days ago • 30

donghyunli/Llama-2-13b-KronQ-W3A16-g128-fake

Text Generation • 13B • Updated 5 days ago • 30

donghyunli/Meta-Llama-3-70B-KronQ-W4A16-g128

Text Generation • 37B • Updated 5 days ago • 31

donghyunli/Meta-Llama-3-70B-KronQ-W2A16-g128

Text Generation • 20B • Updated 5 days ago • 26

donghyunli/Llama-2-70b-KronQ-W3A16-g128-fake

Text Generation • 69B • Updated 5 days ago • 29

donghyunli/Meta-Llama-3-70B-KronQ-W3A16-g128-fake

Text Generation • 71B • Updated 5 days ago • 15

yw223/Qwen3-8B-OmniQuant-3bit

Text Generation • 8B • Updated 9 days ago • 30