Redesign Mixture-of-Experts Routers with Manifold Power Iteration
Paper • 2606.12397 • Published • 80
GregWu
GregYoung
AI & ML interests
None yet
Recent Activity
upvoted a paper 1 day ago
Redesign Mixture-of-Experts Routers with Manifold Power Iteration upvoted a paper 5 days ago
Your UnEmbedding Matrix is Secretly a Feature Lens for Text Embeddings upvoted a paper 5 months ago
Coupling Experts and Routers in Mixture-of-Experts via an Auxiliary LossOrganizations
None yet