Dushyant Rajput

rajpdus

·

AI & ML interests

None yet

Recent Activity

new activity about 15 hours ago

AxiomicLabs/Open_SLM_Leaderboard:Add JugnuLM-110M-R2+ (altslate) Sub-150M, pretrained from scratch (Qwen3-arch + value residuals + Muon, WSD schedule, ~25B tokens on FineWeb-Edu). Open training checkpoint (not merged): https://huggingface.co/altslate/JugnuLM-110M-R2plus Zero-shot, LM-eval harness (acc_norm), + AxiomicLabs ArithMark-3 script: arc (ARC-Easy) 47.64 | hellaswag 36.74 | piqa 65.29 | arcChall (ARC-Challenge) 26.96 | arithmark-3 38.60 109,737,302 params. (arithmark-2 omitted — dataset not publicly available.) NOTE for verification: this is a value-residual model, so it must be loaded with trust_remote_code=True (the repo ships modeling_jugnu_vr.py + auto_map). Loading it as a stock Qwen3 silently drops the value-residual pathway and understates the scores (~6 pts ARC-Easy, etc.). The ArithMark-3 script loads it correctly by default.

updated a model about 15 hours ago

altslate/JugnuLM-110M-R2plus

updated a Space about 22 hours ago

altslate/README

View all activity

Organizations

liked a Space 14 days ago

Tiny-ML Leaderboard

Explore tiny language model rankings and benchmarks