Hugging Face's logo
alphaBell Research's picture

alphaBell Research

alphabell-research
alphabell
68 1 12
dipankarsarkar's profile picture
·
https://alphabell.com

AI & ML interests

Post-training, model behavior and transparent evaluation.

Recent Activity

new activity 4 minutes ago
LiquidAI/LFM3-1.7B:iPhone peak memory and prefill at 128K and 256K context
repliedto ifaposto's post about 4 hours ago
Self-distillation methods usually rely on an Exponential Moving Average (EMA) teachers to get synced and stable critics. However, this doesn't scale well for large models since holding both teacher and student (trained) on GPU increases latency, zero3 communication, etc. We can mitigate this with LoRA finetuning: the backbone is shared & frozen, and we need to maintain two light adapters: one for the student (trained) and one for the teacher (EMA of the student adapter). Getting this to work cleanly under TRL and ZeRO-3 took some fixes, so I packaged it as a plug-and-play repo. It supports: -> robust SDFT implementation that runs under ZeRO-3 -> ZeRO-3 + LoRA integration with adapter switching for teacher/student passes -> Saving and resuming EMA teacher checkpoint -> working deepspeed configs that fix memory spikes when GPU memory is tight I tested on Qwen3.5 and ToolAlpaca. Repo: https://github.com/ifiaposto/sdft_zero3 Feedback/ more examples/ issues welcome!
repliedto ifaposto's post about 5 hours ago
Self-distillation methods usually rely on an Exponential Moving Average (EMA) teachers to get synced and stable critics. However, this doesn't scale well for large models since holding both teacher and student (trained) on GPU increases latency, zero3 communication, etc. We can mitigate this with LoRA finetuning: the backbone is shared & frozen, and we need to maintain two light adapters: one for the student (trained) and one for the teacher (EMA of the student adapter). Getting this to work cleanly under TRL and ZeRO-3 took some fixes, so I packaged it as a plug-and-play repo. It supports: -> robust SDFT implementation that runs under ZeRO-3 -> ZeRO-3 + LoRA integration with adapter switching for teacher/student passes -> Saving and resuming EMA teacher checkpoint -> working deepspeed configs that fix memory spikes when GPU memory is tight I tested on Qwen3.5 and ToolAlpaca. Repo: https://github.com/ifiaposto/sdft_zero3 Feedback/ more examples/ issues welcome!
View all activity

Organizations

alphaBell's profile picture