Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

105

Base only

Active filters: mxfp8

rdtand/Qwen3.5-122B-A10B-PrismaQuant-4.75bit-vllm

Image-Text-to-Text • 72B • Updated Apr 21 • 20.9k • 17

rdtand/Qwen3.6-35B-A3B-PrismaQuant-4.75bit-vllm

Image-Text-to-Text • 21B • Updated Apr 21 • 135k • 27

rdtand/Qwen3.6-27B-PrismaQuant-5.5bit-vllm

Image-Text-to-Text • 18B • Updated Apr 22 • 18.9k • 22

LibraxisAI/Qwen3-VL-235B-A22B-Instruct-mlx-mxfp8

Image-Text-to-Text • 67B • Updated 22 days ago • 186 • 1

TheCluster/Qwen3.6-35B-A3B-Heretic-MLX-mxfp8

Image-Text-to-Text • 35B • Updated Apr 25 • 252 • 2

OsaurusAI/Qwen3.6-35B-A3B-MXFP8-MTP

Image-Text-to-Text • 10B • Updated 15 days ago • 491 • 2

nightmedia/Qwen3-MOE-4x8B-Janus-Blossom-Claude-Gemini-mxfp8-mlx

Text Generation • 24B • Updated Jan 31 • 43

Foxtr0t/Ministral-3-14B-Reasoning-2512-mlx-mxfp8

4B • Updated Feb 8 • 31

vincentzed-hf/Kimi-K2.5-MXFP8

Image-Text-to-Text • 1T • Updated Feb 11 • 10 • 1

TheCluster/GLM-4.6V-Flash-Heretic-MLX-mxfp8

Image-Text-to-Text • 10B • Updated Feb 27 • 59

TheCluster/Qwen3.5-35B-A3B-Heretic-MLX-mxfp8

Image-Text-to-Text • 35B • Updated Apr 17 • 108 • 4

zianglih/Qwen3-30B-A3B-MXFP8

Text Generation • 31B • Updated Mar 2 • 8

zianglih/Qwen3-30B-A3B-Instruct-2507-MXFP8

Text Generation • 31B • Updated Mar 2 • 129

TheCluster/Qwen3.5-9B-Heretic-MLX-mxfp8

Image-Text-to-Text • 9B • Updated Mar 15 • 109 • 2

AxionML/Kimi-K2.5-MXFP8

Image-Text-to-Text • 1T • Updated Mar 3 • 21

TheCluster/Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED-MLX-mxfp8

Image-Text-to-Text • 9B • Updated Apr 25 • 24.8k • 27

zianglih/Qwen2.5-0.5B-Instruct-MXFP8

Text Generation • 0.5B • Updated Mar 4 • 2

TheCluster/Qwen3.5-4B-Heretic-MLX-mxfp8

Image-Text-to-Text • 1B • Updated Mar 5 • 113 • 2

TheCluster/Qwen3.5-27B-Heretic-Text-MLX-mxfp8

Text Generation • 27B • Updated Mar 8 • 16

AITRADER/Jackrong-Qwen3.5-9B-Claude-Reasoning-abliterated-mxfp8-MLX

Text Generation • 3B • Updated Mar 13 • 252 • 2

AITRADER/Jackrong-Qwen3.5-2B-Claude-Reasoning-abliterated-mxfp8-MLX

Text Generation • 0.9B • Updated Mar 13 • 92

AITRADER/Jackrong-Qwen3.5-4B-Claude-Reasoning-abliterated-mxfp8-MLX

Text Generation • 2B • Updated Mar 13 • 112 • 1

zianglih/Qwen3-30B-A3B-MXFP8-last-8-BF16

Text Generation • 31B • Updated Mar 9 • 28

Winnougan/LTX-2.3-INT8

Updated Mar 27 • 9

TheCluster/Qwen3.5-9B-Ultra-Heretic-MLX-mxfp8

Image-Text-to-Text • 9B • Updated Mar 17 • 100 • 2

TheCluster/Qwen3.5-40B-Claude-4.5-Opus-High-Reasoning-Thinking-MLX-mxfp8

Image-Text-to-Text • 39B • Updated Mar 16 • 26 • 1

TheCluster/Qwen3.5-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-MLX-mxfp8

Image-Text-to-Text • 39B • Updated Mar 16 • 390 • 4

wbkou/Qwen3.5-40B-Claude-4.5-Opus-Distilled-MLX-mxfp8

Image-Text-to-Text • 39B • Updated Mar 16 • 23

TheCluster/Crow-9B-HERETIC-4.6-MLX-mxfp8

Image-Text-to-Text • 9B • Updated Mar 17 • 63 • 1

TheCluster/Qwen3.5-9B-Uncensored-HauhauCS-Aggressive-MLX-mxfp8

Image-Text-to-Text • 9B • Updated Mar 17 • 1.09k • 5