Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

870

Full-text search

Active filters: quantization

humbleakh/stable-diffusion-4bit-chain-of-zoom

Updated Jun 8, 2025

humbleakh/chain-of-zoom-4bit-complete

Image-to-Image • Updated Jun 8, 2025

DESUCLUB/Qwen3-14B-v0.2-deepresearch-no-think-100-step-bf16-quantized.w8a8

Text Generation • Updated Jun 10, 2025

LibraxisAI/c4ai-command-a-03-2025-q5-mlx

Updated Jun 11, 2025

Kikinoking/MNLP_M3_quantized_model

Text Generation • 0.6B • Updated Jun 10, 2025

cogni-x/CogniXpert-Model-v1.0

Text Generation • Updated Dec 21, 2025

textgeflecht/Qwen2.5-Coder-32B-Instruct-FP8-dynamic

Text Generation • 33B • Updated Jun 12, 2025 • 66

vlad-m-dev/mobilenetv2_doc_photo_quant

Image Classification • Updated Jun 15, 2025 • 1

vlad-m-dev/mobilenet_v3_small_onnx_photo_doc

Image Classification • Updated Jun 15, 2025 • 2

Peacemann/Meta-Llama-3-8B-Instruct_LMUL

Text Generation • Updated Jun 15, 2025

Peacemann/google_gemma-2-9b-it_LMUL

Text Generation • 9B • Updated Jun 15, 2025 • 1

Peacemann/google_gemma-3-4b-it_LMUL

Text Generation • Updated Jun 15, 2025

Peacemann/mistralai_Mistral-7B-Instruct-v0.2_LMUL

Text Generation • 7B • Updated Jun 15, 2025

Peacemann/Qwen_Qwen2-7B-Instruct_LMUL

Text Generation • Updated Jun 15, 2025 • 2

Peacemann/mistralai_Ministral-8B-Instruct-2410_LMUL

Text Generation • Updated Jun 15, 2025 • 4

Peacemann/Qwen_Qwen3-32B_LMUL

Text Generation • Updated Jun 15, 2025

Peacemann/Qwen_QwQ-32B_LMUL

Text Generation • Updated Jun 15, 2025 • 1

Peacemann/nvidia_Llama-3_3-Nemotron-Super-49B-v1_LMUL

Text Generation • 50B • Updated Jun 15, 2025 • 1

LibraxisAI/QwQ-32B-MLX-Q5

33B • Updated Jun 24, 2025 • 12

LibraxisAI/Qwen3-14b-MLX-Q5

15B • Updated Jun 17, 2025 • 34

avinashhm/Llama-3.1-Nemotron-Nano-4B-v1.1-GPTQ

Text Generation • 5B • Updated Jun 17, 2025 • 1

raul-delarosa99/bert-base-multilingual-cased-ner-es-onnx-static-int8

Token Classification • Updated Aug 25, 2025 • 170

brandonbeiler/InternVL3-38B-FP8-Dynamic

Image-Text-to-Text • 38B • Updated Jun 23, 2025 • 17

brandonbeiler/InternVL3-78B-FP8-Dynamic

Image-Text-to-Text • 78B • Updated Jun 23, 2025 • 231

ramgpt/jan-nano-4b-gptqmodel-4bit

Text Generation • 4B • Updated Jun 20, 2025 • 3 • 2

brandonbeiler/InternVL3-8B-FP8-Dynamic

Image-Text-to-Text • 8B • Updated Jun 23, 2025 • 12 • 2

devatar/quantized_Llama-3.1-8B-Instruct

Text Generation • 8B • Updated Jun 20, 2025 • 62

gpahal/bge-m3-onnx-int8

Feature Extraction • Updated Jun 25, 2025 • 1.71k • 1

pravdin/merged-context-labs-meta-llama-Llama-3.2-3B-Instruct-FP16-unsloth-Llama-3.2-3B-Instruct-gguf

Text Generation • 3B • Updated Jun 26, 2025 • 2

pravdin/merged-Gensyn-Qwen2.5-1.5B-Instruct-Qwen-Qwen2.5-1.5B-Instruct-gguf

Text Generation • 2B • Updated Jun 27, 2025 • 10