Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,310

Base only

Active filters: granite

ibm-granite/granite-4.2-30b

Text Generation • 29B • Updated about 3 hours ago • 287 • 14

ibm-granite/granite-docling-258M

Image-Text-to-Text • 0.3B • Updated Sep 23, 2025 • 408k • 1.25k

ibm-granite/granite-4.2-8b

Text Generation • 9B • Updated about 3 hours ago • 432 • 8

fdtn-ai/antares-1b

Text Generation • 2B • Updated Jul 22 • 21.7k • 286

ibm-granite/granite-4.2-3b

Text Generation • 4B • Updated about 3 hours ago • 653 • 6

ibm-granite/granite-4.1-3b

Text Generation • 3B • Updated May 4 • 135k • 109

mondk/GGUF.granite-4.0-Improved-Enhanced-Refined

Text Generation • 2B • Updated 6 days ago • 163 • 4

mondk/Safetensors.granite-4.0-Improved-Enhanced-Refined

Text Generation • 2B • Updated 6 days ago • 4

ibm-granite/granite-4.1-8b

Text Generation • 9B • Updated May 4 • 1.87M • 253

ibm-granite/granite-embedding-small-english-r2

Feature Extraction • 47.7M • Updated Jan 21 • 5.15M • 77

ibm-granite/granite-4.2-3b-fp8

Text Generation • 4B • Updated 11 days ago • 2

ibm-granite/granite-4.2-8b-nvfp4

Text Generation • 5B • Updated 11 days ago • 2

ibm-granite/granite-3.3-2b-instruct

Text Generation • 3B • Updated May 8, 2025 • 40.7k • 86

ibm-granite/granite-embedding-reranker-english-r2

Text Ranking • 0.1B • Updated Nov 6, 2025 • 33.4k • 29

ibm-granite/granite-4.1-30b

Text Generation • 29B • Updated May 4 • 176k • 145

ibm-granite/granite-embedding-97m-multilingual-r2

Feature Extraction • 97.4M • Updated May 18 • 113k • • 135

fisher046/granite-embedding-311m-multilingual-r2-Q8_0-GGUF

Feature Extraction • 0.3B • Updated Jul 2 • 43 • 1

fdtn-ai/antares-350m

Text Generation • 0.4B • Updated Jul 22 • 1.4k • 73

AXONVERTEX-AI-RESEARCH/antares-1b-Q8_0-GGUF

Text Generation • 2B • Updated Jul 21 • 115 • 5

saidutta69/granite-4.1-8b-heretic

Text Generation • 8B • Updated 3 days ago • 1.94k • 2

Skipti/antares-gguf-community

Text Generation • 2B • Updated Jul 22 • 230 • 1

HolkViking/antares-1b-Q4_K_M-GGUF

Text Generation • 2B • Updated Jul 24 • 11k • 2

HolkViking/antares-1b-Q8_0-GGUF

Text Generation • 2B • Updated Jul 24 • 45 • 1

ibm-granite/granite-4.2-3b-mxfp4

Text Generation • 2B • Updated 11 days ago • 1

bloomee-app/bloomee-v1-clm-nasasmd-granite4.1-3b

Text Generation • 3B • Updated 2 days ago • 203 • 1

Orvena/granite-4.2-3b-MLX-4bit

Text Generation • 0.6B • Updated 3 minutes ago • 1

instructlab/granite-7b-lab

Text Generation • 7B • Updated Jun 5, 2024 • 177 • 43

instructlab/granite-7b-lab-GGUF

7B • Updated Apr 24, 2024 • 341 • 26

ibm-granite/granite-20b-code-base-8k

Text Generation • 20B • Updated Apr 25 • 1.46k • 14

ibm-granite/granite-8b-code-base-4k

Text Generation • 8B • Updated Apr 25 • 2.36k • 31