Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

851

Full-text search

Active filters: quantization

pravdin/meta-llama-Llam-Llama-3.2-3B-dare_linear-gguf

Text Generation • 3B • Updated Jun 28, 2025 • 12

pravdin/meta-I-Hermes-3-dare_linear-gguf

Text Generation • 3B • Updated Jun 28, 2025 • 3

pravdin/Qwen2.5-1.5B-DeepSeek-R1-dare_linear-gguf

Text Generation • 2B • Updated Jul 1, 2025 • 1

169Pi/Alpie-Core

Text Generation • Updated 25 days ago • 57 • 7

JustJaro/SmolLM-135M-FP8-Static

Image-Text-to-Text • 0.2B • Updated Jul 7, 2025 • 1

JustJaro/SmolLM-135M-FP8-Dynamic-Test

Image-Text-to-Text • 0.1B • Updated Jul 7, 2025

JustJaro/GOT-OCR-2.0-hf-FP8-Static

Image-Text-to-Text • 0.6B • Updated Jul 7, 2025 • 6

JustJaro/SmolLM-135M_gptq_g32_4bit

Text Generation • 0.1B • Updated Jul 7, 2025

ConfidentialMind/Mistral-Small-3.2-24B-Instruct-2506-GPTQ-AutoRound-TextOnly

Text Generation • 24B • Updated Jul 7, 2025 • 258

HighCWu/FLUX.1-Kontext-dev-bnb-hqq-4bit

Image-to-Image • Updated Jul 5, 2025 • 199 • 12

Compumacy/Llama-3.2-3B-Instruct-WINT8

Text Generation • 4B • Updated Jul 6, 2025

Compumacy/Meta-Llama-3-8B-Instruct-WFP8

Text Generation • 8B • Updated Jul 6, 2025

Compumacy/Meta-Llama-3-8B-Instruct-WINT8

Text Generation • 8B • Updated Jul 6, 2025 • 1

Compumacy/Phi-4-mini-instruct-WINT4

Text Generation • 4B • Updated Jul 6, 2025 • 1

Compumacy/Meta-Llama-3-8B-Instruct-WINT4

Text Generation • 8B • Updated Jul 6, 2025 • 1

Compumacy/Llama-3.2-3B-Instruct-WINT4

Text Generation • 4B • Updated Jul 6, 2025

brandonbeiler/Skywork-R1V3-38B-FP8-Dynamic

Image-Text-to-Text • 38B • Updated Jul 18, 2025 • 30 • 1

tflsxyy/DeepSeek-V2-Lite-BiMoE-w1g16

Text Generation • 2B • Updated Jul 14, 2025 • 1

codelion/Qwen3-0.6B-accuracy-recovery-lora

Text Generation • Updated Jul 13, 2025 • 174 • 4

Arivukkarasu/TinyLlama-1.1B-Chat-GGUF

1B • Updated Jul 15, 2025 • 74

PJEDeveloper/Mistral-Nemo-Instruct-2407-4bit-20250714_213418

Text Generation • 13B • Updated Jul 15, 2025 • 1

Arivukkarasu/Mistral-7B-Instruct-v0.3-GGUF

7B • Updated Jul 15, 2025

PJEDeveloper/Mistral-7B-Instruct-v0.3-4bit-20250716_003938

Text Generation • 7B • Updated Jul 16, 2025

PJEDeveloper/Mistral-7B-Instruct-v0.2-4bit-20250716_010928

Text Generation • 7B • Updated Jul 16, 2025

kivoai/tinyllama-1.1b-chat-gptq

Text Generation • Updated Jul 19, 2025

codemajesty/gemma2b-4bit-quantized

Text Generation • 3B • Updated Jul 22, 2025 • 2

dev-bjoern/smolvlm-int4-ov

Image-Text-to-Text • Updated Aug 6, 2025 • 23

dev-bjoern/smollm3-int4-ov

Text Generation • Updated Aug 6, 2025 • 2

jw-sohn/Llama-3.1-8B-Instruct-nf4

Text Generation • 8B • Updated Aug 17, 2025 • 2.69k

bijinpanicker/NuNER_Zero-span-ONNX

Token Classification • Updated Jul 30, 2025 • 1