Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

vllm-compatible

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

80

Base only

Active filters: vllm-compatible

AbteeXAILab/lumynax-reasoning-deepseek-r1-distill-llama-70b-gguf

Text Generation • 71B • Updated Jun 7 • 309 • 2

Mitchins/gemma-3-4b-story-outliner

4B • Updated Dec 21, 2025 • 1

tellang/yeji-4b-rslora-v8-AWQ-fixed

Text Generation • 4B • Updated Feb 1 • 6

AbteeXAILab/lumynax-nz-3b

Text Generation • Updated Jun 7 • 1

ravilution/MolmoWeb-4B

Image-Text-to-Text • 5B • Updated Apr 15 • 10

AbteeXAILab/lumynax-infused-gemma-e4b-text-gguf

Text Generation • 8B • Updated Jun 7 • 23

AbteeXAILab/lumynax-infused-qwen3-text-gguf

Text Generation • 8B • Updated Jun 7 • 119

AbteeXAILab/lumynax-infused-phi-4-text-gguf

Text Generation • 15B • Updated Jun 7 • 49

AbteeXAILab/lumynax-reasoning-deepseek-distill-text-gguf

Text Generation • 15B • Updated Jun 7 • 41

AbteeXAILab/lumynax-infused-mistral-small-text-gguf

Text Generation • 24B • Updated Jun 7 • 38

Lorenzob/synch-2-merged

Text Generation • 124B • Updated Apr 26 • 1

Optitransfer/Qwen2.5-7B-Instruct-borg-merge-v1

Text Generation • 8B • Updated May 2 • 19

AbteeXAILab/lumynax-tiny-qwen25-05b-gguf

Text Generation • 0.6B • Updated Jun 7 • 60

AbteeXAILab/lumynax-nz-qwen25-coder-3b-gguf

Text Generation • 3B • Updated Jun 7 • 27

AbteeXAILab/lumynax-infused-qwen3-8b-gguf

Text Generation • 8B • Updated Jun 7 • 25

AbteeXAILab/lumynax-reasoning-gpt-oss-20b-gguf

Text Generation • 21B • Updated Jun 7 • 51

AbteeXAILab/lumynax-infused-qwen3-30b-a3b-gguf

Text Generation • 31B • Updated Jun 7 • 15

AbteeXAILab/lumynax-infused-qwen3-coder-30b-a3b-gguf

Text Generation • 31B • Updated Jun 7 • 41

AbteeXAILab/lumynax-infused-gemma4-26b-a4b-gguf

Text Generation • 25B • Updated Jun 7 • 44

AbteeXAILab/lumynax-moe-moonlight-16b-a3b-gguf

Text Generation • 16B • Updated Jun 7 • 59

AbteeXAILab/lumynax-frontier-minimax-m25-unsloth

Text Generation • 229B • Updated Jun 7 • 56

AbteeXAILab/lumynax-infused-qwen25-15b-instruct-gguf

Text Generation • 2B • Updated Jun 7 • 22

AbteeXAILab/lumynax-infused-qwen25-3b-instruct-gguf

Text Generation • 3B • Updated Jun 7 • 29

AbteeXAILab/lumynax-infused-qwen25-7b-instruct-gguf

Text Generation • 8B • Updated Jun 7 • 44

AbteeXAILab/lumynax-coder-qwen25-05b-instruct-gguf

Text Generation • 0.6B • Updated Jun 7 • 36

AbteeXAILab/lumynax-coder-qwen25-15b-instruct-gguf

Text Generation • 2B • Updated Jun 7 • 18

AbteeXAILab/lumynax-coder-qwen25-7b-instruct-gguf

Text Generation • 8B • Updated Jun 7 • 23

AbteeXAILab/lumynax-coder-qwen25-14b-instruct-gguf

Text Generation • 15B • Updated Jun 7 • 28

AbteeXAILab/lumynax-infused-qwen3-06b-gguf

Text Generation • 0.6B • Updated Jun 7 • 30

AbteeXAILab/lumynax-infused-qwen3-17b-gguf

Text Generation • 2B • Updated Jun 7 • 18