Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

828

Base only

Active filters: ggml

microsoft/VibeVoice-ASR-BitNet

Automatic Speech Recognition • 0.3B • Updated 1 day ago • 32

unsloth/LTX-2.3-GGUF

Image-to-Video • 21B • Updated Apr 20 • 279k • 525

unsloth/FLUX.2-klein-9B-GGUF

Image-to-Image • 9B • Updated Jan 16 • 102k • 282

unsloth/FLUX.2-dev-GGUF

Image-to-Image • 32B • Updated Dec 10, 2025 • 15.7k • 78

unsloth/Z-Image-Turbo-GGUF

Text-to-Image • 6B • Updated Jan 8 • 49.1k • 238

unsloth/FLUX.2-klein-4B-GGUF

Image-to-Image • 4B • Updated Jan 16 • 156k • 186

Serveurperso/ACE-Step-1.5-GGUF

0.7B • Updated Apr 14 • 43.8k • 82

Serveurperso/Qwen3-TTS-GGUF

Text-to-Speech • 0.9B • Updated May 11 • 79k • 29

unsloth/Qwen-Image-Layered-GGUF

Image-Text-to-Image • 20B • Updated Jan 9 • 11.8k • 61

Serveurperso/OmniVoice-GGUF

Text-to-Speech • 0.6B • Updated Apr 30 • 47.4k • 39

mudler/parakeet-cpp-gguf

Automatic Speech Recognition • 0.6B • Updated Jun 6 • 22.9k • 63

mudler/locate-anything.cpp-gguf

Object Detection • 4B • Updated Jun 11 • 5.86k • 11

mudler/depth-anything.cpp-gguf

Depth Estimation • 0.1B • Updated Jun 20 • 19.3k • 10

ilintar/trellis2-gguf

Image-to-3D • 0.2B • Updated 27 days ago • 14.7k • 5

mudler/moss-transcribe.cpp-gguf

Automatic Speech Recognition • 0.9B • Updated 16 days ago • 1.61k • 6

richiejp/deepvqe-aec-gguf

Audio-to-Audio • 7.97M • Updated Apr 27 • 217 • 3

cstr/qwen3-forced-aligner-0.6b-GGUF

Automatic Speech Recognition • 0.9B • Updated Apr 11 • 1.93k • 4

cstr/pyannote-v3-segmentation-GGUF

Voice Activity Detection • 1.49M • Updated Apr 12 • 156 • 1

unsloth/ERNIE-Image-GGUF

Text-to-Image • 8B • Updated Apr 14 • 1.95k • 70

unsloth/ERNIE-Image-Turbo-GGUF

Text-to-Image • 8B • Updated Apr 14 • 7.97k • 227

LocalAI-io/LocalVQE

Audio-to-Audio • 578k • Updated Jun 22 • 6.6k • 63

cstr/vibevoice-asr-GGUF

Automatic Speech Recognition • 8B • Updated 23 days ago • 5.89k • 6

cstr/omniASR-CTC-300M-v2-GGUF

Automatic Speech Recognition • 0.3B • Updated Apr 26 • 113 • 1

cstr/qwen3-tts-tokenizer-12hz-GGUF

Audio-to-Audio • 0.2B • Updated Apr 29 • 3.08k • 3

cstr/kokoro-voices-GGUF

Text-to-Speech • 131k • Updated May 1 • 3k • 2

cstr/kokoro-82m-GGUF

Text-to-Speech • 81.7M • Updated May 1 • 2.51k • 1

cstr/qwen3-tts-1.7b-voicedesign-GGUF

Text-to-Speech • 2B • Updated May 1 • 1.54k • 2

cstr/snac-24khz-GGUF

Text-to-Speech • 13.1M • Updated Jun 23 • 589 • 2

cstr/qwen3-tts-0.6b-customvoice-GGUF

Text-to-Speech • 0.9B • Updated May 1 • 1.21k • 2

cstr/qwen3-tts-1.7b-customvoice-GGUF

Text-to-Speech • 2B • Updated May 1 • 1.73k • 6