Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

21,807

Full-text search

Active filters: llama-cpp

LocoreMind/LocoOperator-4B

Text Generation • 4B • Updated 13 days ago • 5.33k • 273

jwest33/qwen3.5-9b-null-space-abliterated-GGUF

9B • Updated 6 days ago • 19k • 14

EganAI/qwen3.5-9b-terminal-merge

Text Generation • 9B • Updated 2 days ago • 2.63k • 14

ruv/ruvltra-claude-code

Text Generation • 0.5B • Updated Jan 20 • 11.5k • 137

Ex0bit/Qwen3.5-PRISM-Dynamic-Quant-GGUF

Text Generation • 0.8B • Updated 7 days ago • 2.76k • 7

OpenMOSS-Team/MOSS-TTS-GGUF

Text-to-Speech • Updated 1 day ago • 532 • 6

jinaai/jina-embeddings-v5-text-small-retrieval

Sentence Similarity • 0.6B • Updated 7 days ago • 158k • 13

Edge-Quant/Nanbeige4.1-3B-Q4_K_M-GGUF

Text Generation • 4B • Updated 27 days ago • 11.7k • 37

bowang0911/pplx-embed-v1-0.6b-gguf

0.6B • Updated 3 days ago • 81 • 3

ghost-actual/Qwen3.5-4B-Claude-Opus-4.6-Distilled-heretic

Text Generation • 5B • Updated 2 days ago • 758 • 3

ghost-actual/Qwen3.5-27B-Claude-Opus-4.6-Distilled-heretic-GGUF

Text Generation • 27B • Updated 1 day ago • 467 • 3

ggml-org/Meta-Llama-3.1-8B-Instruct-Q4_0-GGUF

Text Generation • 8B • Updated Sep 2, 2024 • 1.22k • 14

hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Sep 25, 2024 • 26k • 27

Trendyol/Qwen3-14B-BaronLLM-v2-Q8

15B • Updated Aug 20, 2025 • 74 • 6

jwest33/ministral-3-3b-instruct-2512-null-space-abliterated-GGUF

Image-Text-to-Text • 4B • Updated Jan 21 • 505 • 2

jinaai/jina-embeddings-v5-text-small-text-matching

Sentence Similarity • 0.6B • Updated 7 days ago • 15.2k • 6

Xlnk/ruvltra-claude-code

Text Generation • 0.5B • Updated 27 days ago • 218 • 8

InquiringMinds-AI/LongCat-Flash-Lite-GGUF

Text Generation • 69B • Updated 6 days ago • 1.15k • 4

HeYujie/Qwen3.5-35B-A3B-abliterated-GGUF

Image-Text-to-Text • 35B • Updated 4 days ago • 5.19k • 7

towardsinnovationlab/Qwen3-8B-medical-gguf

Text Generation • 8B • Updated 2 days ago • 423 • 2

jamesburton/Phi-4-reasoning-vision-15B-GGUF

Text Generation • 15B • Updated 3 days ago • 1.72k • 2

Sumitc13/sarvam-30b-GGUF

32B • Updated about 8 hours ago • 2

joshnader/Phi-3-mini-4k-instruct-Q8_0-GGUF

Text Generation • 4B • Updated Jul 3, 2024 • 22 • 1

NikolayKozloff/Viking-Magnum-v0.1-7B-Q8_0-GGUF

8B • Updated Aug 26, 2024 • 9 • 2

matrixportalx/Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Nov 19, 2024 • 222 • 2

Hack337/QwQ-32B-Preview-abliterated-Q3_K_S-GGUF

Text Generation • 33B • Updated Nov 29, 2024 • 28 • 2

AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF

Text Generation • 8B • Updated Jun 4, 2025 • 613 • 141

sdocio/Llama-3.1-Carballo-Instr3-Q4_K_M-GGUF

Text Generation • 8B • Updated Jun 7, 2025 • 9 • 1

huihui-ai/BaronLLM_Offensive_Security-abliterated-GGUF

Text Generation • 8B • Updated Jun 11, 2025 • 632 • 33

AliCat2/Mistral-Small-3.2-24B-Instruct-2506-Text-Only-Q5_K_M-GGUF

24B • Updated Jun 30, 2025 • 7 • 2