Edit Models filters

Model Tree

PowerInfer/SmallThinker-4BA0.6B-Instruct

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

9

Full-text search

Active filters: PowerInfer/SmallThinker-4BA0.6B-Instruct

PowerInfer/SmallThinker-4BA0.6B-Instruct-GGUF

Text Generation • 4B • Updated Aug 5 • 1.11k • 30

bartowski/PowerInfer_SmallThinker-4BA0.6B-Instruct-GGUF

Text Generation • 4B • Updated Jul 28 • 278

gabriellarson/SmallThinker-4BA0.6B-Instruct-GGUF

Text Generation • 4B • Updated Jul 28 • 215

PowerInfer/SmallThinker-4BA0.6B-Instruct-INT4-QAT

4B • Updated Jul 29 • 74 • 1

mradermacher/SmallThinker-4BA0.6B-Instruct-GGUF

4B • Updated Jul 29 • 138

mradermacher/SmallThinker-4BA0.6B-Instruct-i1-GGUF

4B • Updated Jul 29 • 236

DevQuasar/PowerInfer.SmallThinker-4BA0.6B-Instruct-GGUF

Text Generation • 4B • Updated Jul 30 • 96

noctrex/SmallThinker-4B-A0.6B-Instruct-MXFP4_MOE-GGUF

Text Generation • 4B • Updated Oct 27 • 48

Edge-Quant/SmallThinker-4BA0.6B-Instruct-Q4_K_M-GGUF

Text Generation • 4B • Updated 7 days ago • 7