I wonder how far a model can go if its ‘thoughts’ persist. Early experiments with ideas I’m not ready to explain yet.
Pomilon
Pomilon
·
AI & ML interests
Exploring the intersection of State Space Models and Mixture-of-Experts for low-resource environments... and wondering if they can learn to plan ahead.
Recent Activity
updated
a Space
6 days ago
pomilon-lab/portal
updated
a model
6 days ago
pomilon-lab/Aetheris-MoE-300M-A125M-base
updated
a Space
11 days ago
pomilon-lab/Aetheris-Inference