New in llama.cpp: Anthropic Messages API
•
40
AI & ML interests
None defined yet.
Recent Activity
View all activity
Articles
Collection for Nemotron-3-Super-120B models
Collection for Nemotron-Nano-3-30B-A3B models
Adapters extracted from fine tuned models, using mergekit-extract-lora
-
ggml-org/LoRA-Llama-3-Instruct-abliteration-8B-F16-GGUF
88.1M • Updated • 39 -
ggml-org/LoRA-Qwen2.5-1.5B-Instruct-abliterated-F16-GGUF
93.6M • Updated • 122 • 4 -
ggml-org/LoRA-Qwen2.5-3B-Instruct-abliterated-F16-GGUF
0.1B • Updated • 23 • 1 -
ggml-org/LoRA-Qwen2.5-7B-Instruct-abliterated-v3-F16-GGUF
90.9M • Updated • 49 • 3
Collection for Devstral-Small-2-24B-Instruct-2512 models
Vision and audio models compatible with llama-server and llama-mtmd-cli
-
ggml-org/Ministral-3-3B-Reasoning-2512-GGUF
Image-Text-to-Text • 3B • Updated • 399 • 2 -
ggml-org/Ministral-3-8B-Reasoning-2512-GGUF
Image-Text-to-Text • 8B • Updated • 252 • 1 -
ggml-org/Ministral-3-14B-Reasoning-2512-GGUF
Image-Text-to-Text • 14B • Updated • 232 • 3 -
ggml-org/Ministral-3-3B-Instruct-2512-GGUF
Image-Text-to-Text • 3B • Updated • 560 • 3
Collection of models for Gemma 3-270m
Voice Activity Detection (VAD) models for whisper.cpp.
Models that are used for presets in llama.cpp.
Recommended models for the llama.vim and llama.vscode plugins
-
ggml-org/Qwen2.5-Coder-0.5B-Q8_0-GGUF
Text Generation • 0.5B • Updated • 104k • 7 -
ggml-org/Qwen2.5-Coder-1.5B-Q8_0-GGUF
Text Generation • 2B • Updated • 5.65k • 17 -
ggml-org/Qwen2.5-Coder-3B-Q8_0-GGUF
Text Generation • 3B • Updated • 3.25k • 7 -
ggml-org/Qwen2.5-Coder-7B-Q8_0-GGUF
Text Generation • 8B • Updated • 3.52k • 9
Collection for Nemotron-3-Super-120B models
Collection for Devstral-Small-2-24B-Instruct-2512 models
Collection for Nemotron-Nano-3-30B-A3B models
Vision and audio models compatible with llama-server and llama-mtmd-cli
-
ggml-org/Ministral-3-3B-Reasoning-2512-GGUF
Image-Text-to-Text • 3B • Updated • 399 • 2 -
ggml-org/Ministral-3-8B-Reasoning-2512-GGUF
Image-Text-to-Text • 8B • Updated • 252 • 1 -
ggml-org/Ministral-3-14B-Reasoning-2512-GGUF
Image-Text-to-Text • 14B • Updated • 232 • 3 -
ggml-org/Ministral-3-3B-Instruct-2512-GGUF
Image-Text-to-Text • 3B • Updated • 560 • 3
Collection of models for Gemma 3-270m
Voice Activity Detection (VAD) models for whisper.cpp.
Models that are used for presets in llama.cpp.
Adapters extracted from fine tuned models, using mergekit-extract-lora
-
ggml-org/LoRA-Llama-3-Instruct-abliteration-8B-F16-GGUF
88.1M • Updated • 39 -
ggml-org/LoRA-Qwen2.5-1.5B-Instruct-abliterated-F16-GGUF
93.6M • Updated • 122 • 4 -
ggml-org/LoRA-Qwen2.5-3B-Instruct-abliterated-F16-GGUF
0.1B • Updated • 23 • 1 -
ggml-org/LoRA-Qwen2.5-7B-Instruct-abliterated-v3-F16-GGUF
90.9M • Updated • 49 • 3
Recommended models for the llama.vim and llama.vscode plugins
-
ggml-org/Qwen2.5-Coder-0.5B-Q8_0-GGUF
Text Generation • 0.5B • Updated • 104k • 7 -
ggml-org/Qwen2.5-Coder-1.5B-Q8_0-GGUF
Text Generation • 2B • Updated • 5.65k • 17 -
ggml-org/Qwen2.5-Coder-3B-Q8_0-GGUF
Text Generation • 3B • Updated • 3.25k • 7 -
ggml-org/Qwen2.5-Coder-7B-Q8_0-GGUF
Text Generation • 8B • Updated • 3.52k • 9