Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

dynamic-quantization

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

92

Base only

Active filters: dynamic-quantization

amd/Qwen3-VL-8B-Instruct-w8a8-llmcompressor-v0.12.0

Image-Text-to-Text • 9B • Updated 5 days ago • 59

ModelCloud/Phi-tiny-MoE-instruct-GPTQ-W4-MixedGroup-G32-G128

Text Generation • 4B • Updated 8 days ago • 22