Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

distributed-inference

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

107

Base only

Active filters: distributed-inference

meshllm/Llama-3.3-70B-Instruct-Q3_K_M-draft-layers

Text Generation • 0.9B • Updated 13 days ago • 1.93k

meshllm/MiniMax-M2.5-UD-Q4_K_XL-layers

Text Generation • 4B • Updated 13 days ago • 1.9k

meshllm/Qwen3.5-122B-A10B-UD-Q4_K_XL-layers

Text Generation • 3B • Updated 13 days ago • 1.86k

meshllm/Mistral-Small-4-119B-2603-UD-Q4_K_XL-layers

Text Generation • 3B • Updated 13 days ago • 1.27k

meshllm/Llama-4-Scout-17B-16E-Instruct-UD-Q4_K_XL-layers

Text Generation • 2B • Updated 13 days ago • 2.22k

meshllm/Qwen3-Coder-Next-UD-Q4_K_XL-layers

Text Generation • 2B • Updated 12 days ago • 1.31k

meshllm/DeepSeek-R1-Distill-Llama-70B-UD-Q4_K_XL-layers

Text Generation • 0.9B • Updated 12 days ago • 3.16k

meshllm/NVIDIA-Nemotron-3-Nano-Omni-30B-A3B-Reasoning-UD-Q4_K_XL-layers

Text Generation • 38.7M • Updated 12 days ago • 1.56k

meshllm/gemma-4-31B-it-UD-Q4_K_XL-layers

Text Generation • 0.5B • Updated 12 days ago • 2.48k

meshllm/Step-3.7-Flash-UD-Q4_K_XL-layers

Text Generation • 0.2B • Updated 11 days ago • 1.23k

meshllm/Qwen3-Next-80B-A3B-Instruct-UD-Q4_K_XL-layers

Text Generation • 2B • Updated 11 days ago • 1.3k

meshllm/Nemotron-3-Nano-30B-A3B-UD-Q4_K_XL-layers

Text Generation • 38.7M • Updated 11 days ago • 1.54k

meshllm/DeepSeek-R1-Distill-Qwen-32B-Q4_K_M-layers

Text Generation • 0.5B • Updated 11 days ago • 2.13k

meshllm/Qwen3-Next-80B-A3B-Thinking-UD-Q4_K_XL-layers

Text Generation • 2B • Updated 10 days ago • 1.27k

meshllm/granite-4.1-30b-UD-Q4_K_XL-layers

Text Generation • 0.4B • Updated 10 days ago • 1.42k

meshllm/GLM-4.7-Flash-UD-Q4_K_XL-layers

Text Generation • 84.7M • Updated 10 days ago • 1.57k

meshllm/gemma-3-27b-it-UD-Q4_K_XL-layers

Text Generation • 0.4B • Updated 10 days ago • 1.61k

meshllm/Mistral-Small-3.2-24B-Instruct-2506-UD-Q4_K_XL-layers

Text Generation • 0.6B • Updated 10 days ago • 1.27k

meshllm/Qwen3.6-35B-A3B-UD-Q4_K_XL-layers

Text Generation • 0.8B • Updated 9 days ago • 1.77k

meshllm/Devstral-Small-2505-UD-Q4_K_XL-layers

Text Generation • 0.6B • Updated 9 days ago • 1.37k

meshllm/GLM-4.7-Flash-REAP-23B-A3B-UD-Q4_K_XL-layers

Text Generation • 84.7M • Updated 9 days ago • 1.54k

meshllm/ERNIE-4.5-21B-A3B-PT-UD-Q4_K_XL-layers

Text Generation • 0.1B • Updated 9 days ago • 708

meshllm/Qwen3.5-35B-A3B-UD-Q4_K_XL-layers

Text Generation • 0.8B • Updated 8 days ago • 1.6k

meshllm/Devstral-Small-2-24B-Instruct-2512-UD-Q4_K_XL-layers

Text Generation • 0.6B • Updated 8 days ago • 1.65k

meshllm/ERNIE-4.5-21B-A3B-Thinking-UD-Q4_K_XL-layers

Text Generation • 0.1B • Updated 8 days ago • 671

meshllm/gpt-oss-20b-UD-Q4_K_XL-layers

Text Generation • 0.8B • Updated 8 days ago • 1.49k

meshllm/Qwen3-VL-32B-Instruct-UD-Q4_K_XL-layers

Text Generation • 0.5B • Updated 7 days ago • 1.48k

meshllm/DeepSeek-R1-Distill-Qwen-14B-Q4_K_M-layers

Text Generation • 0.3B • Updated 7 days ago • 1.15k

meshllm/Qwen3-VL-32B-Thinking-UD-Q4_K_XL-layers

Text Generation • 0.5B • Updated 6 days ago • 2.24k • 1

meshllm/NVIDIA-Nemotron-3-Ultra-550B-A55B-UD-Q4_K_XL-layers

Text Generation • 0.4B • Updated 5 days ago • 2.96k