Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

6,618

Base only

Active filters: llama.cpp

audreyt/CyberNeurova-DeepSeek-V4-Flash-abliterated-GGUF

Text Generation • 284B • Updated 3 days ago • 7.91k • 12

OBLITERATUS/Qwen3.6-27B-OBLITERATED

Text Generation • 27B • Updated May 23 • 21.5k • 179

notSnix/Step-3.7-Flash-Q4_K_M-MTP-GGUF

Text Generation • 197B • Updated Jun 3 • 2k • 11

jcbtc/chadrock-35b-ace-saber-rocmfp4-mtp

Image-Text-to-Text • 36B • Updated 3 days ago • 1.92k • 12

yuxinlu1/Mellum2-12B-A2.5B-Claude-4.6-4.8-Opus-Thinking-GGUF

Text Generation • 12B • Updated 27 days ago • 13.1k • 28

AtomicChat/ornith-35b-GGUF

Text Generation • 35B • Updated 10 days ago • 2.81k • 6

s-batman/Ornith-1.0-9B-NVFP4-MTP-GGUF

Text Generation • 9B • Updated 7 days ago • 8.96k • 3

williamliao/Qwen3.6-35B-A3B-DFlash-GGUF

Text Generation • 0.4B • Updated 7 days ago • 1.21k • 3

protoLabsAI/Agents-A1-MTP-GGUF

Text Generation • 36B • Updated 2 days ago • 1.99k • 3

google/codegemma-7b-it-GGUF

Text Generation • 9B • Updated Jun 27, 2024 • 154 • 69

prithivMLmods/Qwen3-VL-4B-Instruct-abliterated-v1-GGUF

Image-Text-to-Text • 4B • Updated Dec 15, 2025 • 2.15k • 7

LiquidAI/LFM2.5-1.2B-Instruct-GGUF

Text Generation • 1B • Updated Apr 6 • 177k • 186

LiquidAI/LFM2.5-1.2B-Thinking-GGUF

Text Generation • 1B • Updated Apr 6 • 12.3k • 103

TeichAI/GLM-4.7-Flash-Claude-Opus-4.5-High-Reasoning-Distill-GGUF

30B • Updated Feb 22 • 5.25k • 510

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 14.2k • 731

khazarai/Qwen3-4B-Qwen3.6-plus-Reasoning-Distilled-GGUF

Text Generation • 4B • Updated Apr 19 • 10.7k • 47

groxaxo/Huihui-gemma-4-26B-A4B-it-abliterated-GGUF

Image-Text-to-Text • 25B • Updated Apr 22 • 22.6k • 27

WithinUsAI/Opus4.7-GODs.Ghost.Codex-4B.GGuF

Text Generation • 4B • Updated 17 days ago • 8.98k • 95

froggeric/Qwen3.6-27B-MTP-GGUF

Image-Text-to-Text • Updated May 21 • 12.4k • 76

AtomicChat/gemma-4-E4B-it-assistant-GGUF

Text Generation • 78.8M • Updated May 7 • 4.9k • 20

GestaltLabs/Qwen3.6-35B-A3B-NSC-ACE-SABER-GGUF-MTP

Image-Text-to-Text • 36B • Updated May 14 • 21.1k • 18

tnhnyzc/MiMO-V2.5-MTP-GGUF

Text Generation • 310B • Updated May 12 • 134 • 5

s-batman/Qwen3.6-27B-NVFP4-MTP-GGUF

Text Generation • 27B • Updated 10 days ago • 1.06k • 5

Jackrong/Qwopus3.6-35B-A3B-v1-MTP-GGUF

Image-Text-to-Text • Updated May 28 • 32.6k • 51

tvall43/Qwen3.6-14B-A3B-VibeForged-v2-GGUF

Text Generation • 14B • Updated May 29 • 32.3k • 29

AlicanKiraz0/Titus-CybersecurityLLM-v1.0-Q4_K_M-No-MTP-GGUF

Text Generation • 35B • Updated Jun 1 • 2.87k • 20

younissk/nanoBeard-frigate-360M-GGUF

Text Generation • 0.4B • Updated Jun 1 • 713 • 2

bytkim/Qwen3.6-27B-MTP-pi-tune-GGUF

Text Generation • 27B • Updated 21 days ago • 99.4k • 119

rafw007/qwen36-a3b-claude-coder-llama.cpp-GGUF

Text Generation • 36B • Updated 29 days ago • 13.2k • 5

michaelw9999/Qwen3.6-35B-A3B-NVFP4-MTP-GGUF

Text Generation • 36B • Updated 24 days ago • 145k • 6