schneiderkamplab/DFM-Mimir-FP4-MLX
Text Generation • 2B • Updated • 223
Schneider-Kamp Lab
university
AI & ML interests
- Ressource constrained language modelling - Evaluation - Low-Bandwidth Distributed Training - Quantization - Medical Language Modelling - AI x Human
Recent Activity
View all activity
Papers
FlexMoRE: A Flexible Mixture of Rank-heterogeneous Experts for Efficient Federatedly-trained Large Language Models
DeToNATION: Decoupled Torch Network-Aware Training on Interlinked Online Nodes