Overworld/Waypoint-1.1-Small
Updated
•
135
•
8
denis
dananev
·
AI & ML interests
None yet
Recent Activity
liked
a model
about 4 hours ago
Overworld/Waypoint-1.1-Small
liked
a model
2 days ago
ByteDance/Video-As-Prompt-CogVideoX-5B
liked
a model
2 days ago
ByteDance/Video-As-Prompt-Wan2.1-14B
Organizations
None yet
liked
a
model
about 4 hours ago
liked
8
models
2 days ago
ByteDance/Video-As-Prompt-CogVideoX-5B
Image-to-Video
•
Updated
•
42
•
22
ByteDance/Video-As-Prompt-Wan2.1-14B
Image-to-Video
•
Updated
•
62
•
48
ByteDance/Ouro-1.4B
Text Generation
•
Updated
•
15.1k
•
59
Qwen/Qwen3-Omni-30B-A3B-Captioner
Any-to-Any
•
32B
•
Updated
•
11.6k
•
196
tsinghua-ee/video-SALMONN-2_plus_3B
Updated
•
847
•
3
MU-NLPC/whisper-tiny-audio-captioning
Updated
•
115
•
15
microsoft/msclap
Updated
•
35
tsinghua-ee/video-SALMONN-2
Video-Text-to-Text
•
9B
•
Updated
•
191
•
1
upvoted
a
paper
6 days ago
liked
2
Spaces
6 days ago
liked
2
models
7 days ago
liked
4
models
9 days ago
reacted to
reach-vb's
post with 👍
about 1 year ago
Post
2435
On-device AI framework ecosystem is blooming these days:
1. llama.cpp - All things Whisper, LLMs & VLMs - run across Metal, CUDA and other backends (AMD/ NPU etc)
https://github.com/ggerganov/llama.cpp
2. MLC - Deploy LLMs across platforms especially WebGPU (fastest WebGPU LLM implementation out there)
https://github.com/mlc-ai/web-llm
3. MLX - Arguably the fastest general purpose framework (Mac only) - Supports all major Image Generation (Flux, SDXL, etc), Transcription (Whisper), LLMs
https://github.com/ml-explore/mlx-examples
4. Candle - Cross-platform general purpose framework written in Rust - wide coverage across model categories
https://github.com/huggingface/candle
Honorable mentions:
1. Transformers.js - Javascript (WebGPU) implementation built on top of ONNXruntimeweb
https://github.com/xenova/transformers.js
2. Mistral rs - Rust implementation for LLMs & VLMs, built on top of Candle
https://github.com/EricLBuehler/mistral.rs
3. Ratchet - Cross platform, rust based WebGPU framework built for battle-tested deployments
https://github.com/huggingface/ratchet
4. Zml - Cross platform, Zig based ML framework
https://github.com/zml/zml
Looking forward to how the ecosystem would look 1 year from now - Quite bullish on the top 4 atm - but open source ecosystem changes quite a bit! 🤗
Also, which frameworks did I miss?
1. llama.cpp - All things Whisper, LLMs & VLMs - run across Metal, CUDA and other backends (AMD/ NPU etc)
https://github.com/ggerganov/llama.cpp
2. MLC - Deploy LLMs across platforms especially WebGPU (fastest WebGPU LLM implementation out there)
https://github.com/mlc-ai/web-llm
3. MLX - Arguably the fastest general purpose framework (Mac only) - Supports all major Image Generation (Flux, SDXL, etc), Transcription (Whisper), LLMs
https://github.com/ml-explore/mlx-examples
4. Candle - Cross-platform general purpose framework written in Rust - wide coverage across model categories
https://github.com/huggingface/candle
Honorable mentions:
1. Transformers.js - Javascript (WebGPU) implementation built on top of ONNXruntimeweb
https://github.com/xenova/transformers.js
2. Mistral rs - Rust implementation for LLMs & VLMs, built on top of Candle
https://github.com/EricLBuehler/mistral.rs
3. Ratchet - Cross platform, rust based WebGPU framework built for battle-tested deployments
https://github.com/huggingface/ratchet
4. Zml - Cross platform, Zig based ML framework
https://github.com/zml/zml
Looking forward to how the ecosystem would look 1 year from now - Quite bullish on the top 4 atm - but open source ecosystem changes quite a bit! 🤗
Also, which frameworks did I miss?
- 1 reply
liked
a
model
about 1 year ago
