MoE Pruning Analysis Project

AI & ML interests

None defined yet.

Recent Activity

atsuki-yamaguchi  authored a paper 3 days ago

How Can We Synthesize High-Quality Pretraining Data? A Systematic Study of Prompt Design, Generator Model, and Source Data

atsuki-yamaguchi  authored a paper 3 days ago

MultiHashFormer: Hash-based Generative Language Models

atsuki-yamaguchi  authored a paper 3 days ago

On the Utility and Factual Reliability of Pruned Mixture-of-Experts Models in the Biomedical Domain

View all activity

Team members 1