Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

550

Base only

Active filters: mobile

HMMediaLabs-Smacksmack206/Qwen3.5-4B-Heretic-MNN-4bit-Uncensored

Text Generation • Updated Mar 16 • 2

darkmaniac7/Qwen3.5-4B-uncensored-MNN

Updated Jul 4 • 740 • 2

airev-ae/Qwen-0.8B-AgentJSON

Text Generation • 0.8B • Updated Mar 26 • 29 • 2

leoxs22/manga-panel-detector-yolo26n

Object Detection • Updated Mar 30 • 133 • 13

futo-org/futo-swipe

Other • Updated Jun 26 • 714 • 41

Dvirile/chatterbox-turbo-lora

Text-to-Speech • Updated 27 days ago • 1

dispatchAI/Qwen2.5-Coder-7B-mobile

Text Generation • 8B • Updated Jun 26 • 23 • 1

dispatchAI/Llama-3.2-3B-FunctionCall-mobile

Text Generation • 3B • Updated Jun 28 • 23 • 1

FINAL-Bench/POCKET-35B-GGUF

Text Generation • 35B • Updated 18 days ago • 245k • 70

NimaBoscarino/efficientformer-l1-1000

Image Classification • Updated Jul 18, 2022 • 1

NimaBoscarino/efficientformer-l1-300

Image Classification • Updated Jul 18, 2022 • 17

NimaBoscarino/efficientformer-l3-300

Image Classification • Updated Jul 18, 2022 • 3 • 2

NimaBoscarino/efficientformer-l7-300

Image Classification • Updated Jul 18, 2022 • 3

snap-research/efficientformer-l1-300

Image Classification • Updated May 24, 2023 • 67 • 4

snap-research/efficientformer-l7-300

Image Classification • Updated Jan 22, 2023 • 20 • 1

snap-research/efficientformer-l3-300

Image Classification • Updated May 24, 2023 • 13 • 3

currentlyexhausted/mobile-llm

Text Generation • Updated May 11, 2023 • 7 • 1

mvasiliniuc/iva-codeint-swift-small

Text Generation • Updated Jul 9, 2023 • 14 • 2

mvasiliniuc/iva-codeint-kotlin-small

Text Generation • Updated Jul 9, 2023 • 20 • 1

macadeliccc/llama-3-8b-instruct-pte

Updated Jul 31, 2024 • 9

chatpdflocal/gemma2-instruct-gguf

3B • Updated Mar 23 • 183 • 7

chatpdflocal/mistral-nemo-instruct-gguf

12B • Updated Dec 27, 2024 • 33 • 5

IAmTheHaider/POT-YOLO

Object Detection • Updated Aug 19, 2024 • 12

Lewdiculous/MN-BackyardAI-Party-12B-v1-GGUF-IQ-ARM-Imatrix

12B • Updated Oct 3, 2024 • 1.67k • 16

ijktech/ByteGPT-small

Text Generation • 86.2M • Updated Mar 6, 2025 • 10

chatpdflocal/deepseek-r1-distill-llama-8b-gguf

8B • Updated Feb 27, 2025 • 12

chatpdflocal/deepseek-r1-distill-qwen-7b-gguf

8B • Updated Feb 27, 2025 • 19

ijktech/ByteGPT-r1

Text Generation • 2B • Updated Mar 6, 2025 • 13

mradermacher/ByteGPT-r1-GGUF

2B • Updated Mar 6, 2025 • 28 • 1

chatpdflocal/gemma-3-12b-it-gguf

12B • Updated Apr 23 • 69 • 3