Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

859

Full-text search

Active filters: quantization

Ram07/bitskip-v3-earlyexit

Text Generation • 1.0B • Updated Oct 14, 2025 • 4

Ram07/llama3-earlyexit

Text Generation • 1.0B • Updated Oct 14, 2025

huawei-csl/Qwen3-1.7B-3bit-ASINQ

Text Generation • 0.5B • Updated Feb 2 • 5 • 7

huawei-csl/Qwen3-14B-3bit-SINQ

Text Generation • 3B • Updated Feb 2 • 5 • 5

huawei-csl/Qwen3-14B-3bit-ASINQ

Text Generation • 3B • Updated Feb 2 • 21 • 5

huawei-csl/Qwen3-32B-3bit-SINQ

Text Generation • 6B • Updated Feb 2 • 7 • 6

huawei-csl/Qwen3-32B-3bit-ASINQ

Text Generation • 6B • Updated Feb 2 • 4 • 5

huawei-csl/Qwen3-1.7B-4bit-SINQ

Text Generation • 1B • Updated Feb 2 • 5 • 5

huawei-csl/Qwen3-1.7B-4bit-ASINQ

Text Generation • 1B • Updated Feb 2 • 4 • 5

huawei-csl/Qwen3-32B-4bit-SINQ

Text Generation • 18B • Updated Feb 2 • 11 • 7

huawei-csl/Qwen3-14B-4bit-SINQ

Text Generation • 9B • Updated Feb 2 • 7 • 5

huawei-csl/Qwen3-14B-4bit-ASINQ

Text Generation • 9B • Updated Feb 2 • 3 • 6

huawei-csl/Qwen3-32B-4bit-ASINQ

Text Generation • 18B • Updated Feb 2 • 6 • 8

raining-codes/Gemma3-1B-LOMO-q4f16_1-MLC

Text Generation • Updated Oct 19, 2025

raining-codes/Gemma3-270M-LOMO-q4f16_1-MLC

Text Generation • Updated Oct 19, 2025

raining-codes/Qwen3-0.6B-LOMO-q4f16_1-MLC

Text Generation • Updated Oct 19, 2025

raining-codes/Qwen3-1.7B-LOMO-q4f16_1-MLC

Text Generation • Updated Oct 20, 2025

selimaktas/Qwen3-14B-FP8-MinMax

15B • Updated Oct 20, 2025 • 1

raining-codes/Qwen3-1.7B-LOMO-q4f16_1-MLC2

Text Generation • Updated Oct 21, 2025 • 1

AhtnaGlen/phi-4-mini-instruct-int4-sym-npu-ov

Text Generation • Updated Oct 27, 2025 • 4

wangkanai/wan22-qx-encoders-gguf

Text-to-Video • 6B • Updated Oct 28, 2025 • 813 • 5

richardyoung/Kimi-K2-Instruct-0905-MLX-5bit

Text Generation • 1T • Updated Nov 26, 2025 • 54

sanchezalonsodavid17/DeepSeek-OCR-MBQ-Quantized-v1

Image-Text-to-Text • 3B • Updated Nov 6, 2025 • 142 • 6

huawei-csl/Qwen3-235B-A22B-3bit-SINQ

Text Generation • Updated Feb 2 • 2 • 2

huawei-csl/Apertus-8B-2509-4bit-SINQ

Text Generation • 5B • Updated Feb 2 • 2

huawei-csl/Apertus-8B-2509-4bit-ASINQ

Text Generation • 5B • Updated Feb 2 • 5 • 2

cocorang/ChronoEdit-14B-Diffusers-FP8

Updated Nov 1, 2025 • 7

Ex0bit/Qwen3-VLTO-32B-Instruct-NVFP4

Text Generation • 17B • Updated Nov 3, 2025 • 358 • 1

Ex0bit/Qwen3-VLTO-32B-Instruct-NVFP4-256K

Text Generation • 17B • Updated Nov 4, 2025 • 36 • 1

brabooObrabo/Kimi-Linear-48B-A3B-Instruct-MXFP4-GS32-MLX

Text Generation • 49B • Updated Nov 8, 2025 • 109 • 2