Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

6,749

Base only

Active filters: llama.cpp

migtissera/Tess-4-27B-GGUF

Image-Text-to-Text • 27B • Updated 12 minutes ago • 2

google/codegemma-2b-GGUF

Text Generation • 3B • Updated Jun 27, 2024 • 106 • 35

google/codegemma-7b-GGUF

Text Generation • 9B • Updated Jun 27, 2024 • 60 • 27

mistralai/Magistral-Small-2509-GGUF

24B • Updated Sep 18, 2025 • 1.73k • 74

ShahzebKhoso/Qwen3Guard-Gen-8B-GGUF

8B • Updated Sep 24, 2025 • 212 • 2

LiquidAI/LFM2-VL-3B-GGUF

Image-Text-to-Text • 3B • Updated Mar 30 • 4.09k • 38

fawazo/qwen2.5-coder-3b-pentest-gguf

3B • Updated Dec 9, 2025 • 551 • 2

LiquidAI/LFM2.5-1.2B-JP-GGUF

Text Generation • 1B • Updated Mar 30 • 1.18k • 30

LiquidAI/LFM2.5-1.2B-Thinking-GGUF

Text Generation • 1B • Updated Apr 6 • 11.9k • 103

TeichAI/GLM-4.7-Flash-Claude-Opus-4.5-High-Reasoning-Distill-GGUF

30B • Updated Feb 22 • 5.57k • 510

LiquidAI/LFM2-24B-A2B-GGUF

Text Generation • 24B • Updated Mar 30 • 5.15k • 136

jinaai/jina-embeddings-v5-text-small-retrieval-GGUF

Sentence Similarity • 0.6B • Updated Feb 25 • 1.61k • 9

Voodisss/Qwen3-Reranker-4B-GGUF-llama_cpp

Text Ranking • 4B • Updated Mar 10 • 4.81k • 13

RamRamki/medical-phi3

4B • Updated Mar 15 • 39 • 1

michaelw9999/Nemotron-Cascade-2-30B-A3B-NVFP4-GGUF

Text Generation • 32B • Updated Apr 2 • 129 • 5

prism-ml/Bonsai-1.7B-gguf

Text Generation • 2B • Updated Apr 18 • 5.22k • 76

khazarai/Qwen3-4B-Qwen3.6-plus-Reasoning-Distilled-GGUF

Text Generation • 4B • Updated Apr 19 • 10.7k • 47

S4MPL3BI4S/gemma4-coding-agent

8B • Updated Apr 10 • 10.9k • 27

Ex0bit/Gemma4-26B-A4B-PRISM-PRO-DQ-GGUF

Image-Text-to-Text • 25B • Updated Apr 11 • 18.8k • 76

groxaxo/Huihui-gemma-4-26B-A4B-it-abliterated-GGUF

Image-Text-to-Text • 25B • Updated Apr 22 • 21.5k • 27

karthik0098/debate-debater-1.7b

Text Generation • 2B • Updated Apr 15 • 10 • 1

mradermacher/Qwen3.5-9B-GLM5.1-Distill-v1-i1-GGUF

Text Generation • 9B • Updated Apr 19 • 769 • 12

0xSero/Qwen3.6-35B-GGUF

Text Generation • 35B • Updated May 30 • 770 • 22

thejemish/crop-disease-finder-gemma4-e2b-GGUF

5B • Updated Apr 20 • 10 • 1

3fou34jfioqjf3q0pf/rp-model_E2B_v5.1

5B • Updated Apr 22 • 4 • 2

batiai/Qwen3.6-27B-GGUF

Text Generation • 27B • Updated Jun 6 • 155k • 6

kai-os/Carnice-V2-27b-GGUF

27B • Updated Apr 25 • 41.4k • 108

leeminwaan/qwen3.5_4B_AiO_LR_lora_kimi_k2.5_distilation

Image-Text-to-Text • 4B • Updated Apr 26 • 644 • 3

cHunter789/Qwen3.6-27B-i1-IQ4_XS-GGUF

Text Generation • 27B • Updated May 2 • 2.17k • 31

Shadow0482/mythos

Any-to-Any • 5B • Updated Apr 28 • 2.71k • 4