Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

quantization-aware-training

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

12

Base only

Active filters: quantization-aware-training

Thomaschtl/qwen3-0.6b-qat-test

Text Generation • Updated Jun 3, 2025

Thomaschtl/qwen3-06b-qat-test

Text Generation • Updated Jun 3, 2025

Thomaschtl/test2

Text Generation • Updated Jun 4, 2025 • 3

Thomaschtl/test3

Text Generation • Updated Jun 4, 2025 • 2

tokenlabsdotrun/Llama-3.1-8B-Unsloth-FP8_INT4-QAT

Text Generation • Updated Jan 19 • 6

shivnathtathe/T4NT-0.5B

Text Generation • Updated Mar 24 • 5 • 2

Venugopalan2610/BCJR-QAT-Llama-3.2-1B-2bit

jpcurada/SmolLM2-1.7B-Scheduled-QAT-Linear-INT4

Text Generation • 2B • Updated 28 days ago • 56

jpcurada/SmolLM2-1.7B-Scheduled-QAT-Linear-GGUF

Text Generation • 2B • Updated 28 days ago • 178

KEVIN04087/edgevl-ovc-scannet

Updated 25 days ago

FoeverBLUE/Qwen3-VL-2B-GRACE-W8G128

Image-Text-to-Text • 2B • Updated 6 days ago • 26

Debanjan24/volumetric-ptv3-qat-8bit

Updated 12 days ago