j0no12/nero-optimizer-work-adamw
Text Generation • Updated • 38
Optimizer Work
Nero MLX optimizer experiments trained for 500M tokens at context length 128.
-
-
j0no12/nero-optimizer-work-bad
Text Generation • Updated • 35 -
j0no12/nero-optimizer-work-flux
Text Generation • Updated • 66 -
j0no12/nero-optimizer-work-gated-muon-simo
Text Generation • Updated • 33 -
j0no12/nero-optimizer-work-gated-muon-simo-lr0p00025
Text Generation • Updated • 32 -
j0no12/nero-optimizer-work-gated-muon-simo-lr0p0005
Text Generation • Updated • 30 -
j0no12/nero-optimizer-work-gated-muon-simo-lr0p001
Text Generation • Updated • 30 -
j0no12/nero-optimizer-work-gated-muon-simo-lr0p002
Text Generation • Updated • 42 -
j0no12/nero-optimizer-work-gated-simo
Text Generation • Updated • 31 -
j0no12/nero-optimizer-work-gated-simo-lr0p00025
Text Generation • Updated • 34 -
j0no12/nero-optimizer-work-gated-simo-lr0p0005
Text Generation • Updated • 32 -
j0no12/nero-optimizer-work-gated-simo-lr0p001
Text Generation • Updated • 32 -
j0no12/nero-optimizer-work-gated-simo-lr0p002
Text Generation • Updated • 30 -
j0no12/nero-optimizer-work-gated-simow
Text Generation • Updated • 34 -
j0no12/nero-optimizer-work-gated-simow-lr0p00025
Text Generation • Updated • 33 -
j0no12/nero-optimizer-work-gated-simow-lr0p0005
Text Generation • Updated • 31 -
j0no12/nero-optimizer-work-gated-simow-lr0p001
Text Generation • Updated • 34 -
j0no12/nero-optimizer-work-gated-simow-lr0p002
Text Generation • Updated • 34 -
j0no12/nero-optimizer-work-m-simow-b0p5-lr0p002
Text Generation • Updated • 39 -
j0no12/nero-optimizer-work-m-simow-b0p5-lr0p003
Text Generation • Updated • 36 -
j0no12/nero-optimizer-work-m-simow-b0p5-lr0p004
Text Generation • Updated • 38 -
j0no12/nero-optimizer-work-m-simow-b0p5-lr0p006
Text Generation • Updated • 32 -
j0no12/nero-optimizer-work-m-simow-b0p8-lr0p002
Text Generation • Updated • 34 -
j0no12/nero-optimizer-work-m-simow-b0p8-lr0p003
Text Generation • Updated • 34 -
j0no12/nero-optimizer-work-m-simow-b0p8-lr0p004
Text Generation • Updated • 37 -
j0no12/nero-optimizer-work-m-simow-b0p8-lr0p006
Text Generation • Updated • 32 -
j0no12/nero-optimizer-work-m-simow-b0p95-lr0p002
Text Generation • Updated • 34 -
j0no12/nero-optimizer-work-m-simow-b0p95-lr0p003
Text Generation • Updated • 36 -
j0no12/nero-optimizer-work-m-simow-b0p95-lr0p004
Text Generation • Updated • 36 -
j0no12/nero-optimizer-work-m-simow-b0p95-lr0p006
Text Generation • Updated • 34 -
j0no12/nero-optimizer-work-m-simow-b0p9-lr0p002
Text Generation • Updated • 34 -
j0no12/nero-optimizer-work-m-simow-b0p9-lr0p003
Text Generation • Updated • 40 -
j0no12/nero-optimizer-work-m-simow-b0p9-lr0p004
Text Generation • Updated • 36 -
j0no12/nero-optimizer-work-m-simow-b0p9-lr0p006
Text Generation • Updated • 40 -
j0no12/nero-optimizer-work-navier
Text Generation • Updated • 40 -
j0no12/nero-optimizer-work-simo
Text Generation • Updated • 40 -
j0no12/nero-optimizer-work-simo-lr0p00025
Text Generation • Updated • 38 -
j0no12/nero-optimizer-work-simo-lr0p0005
Text Generation • Updated • 42 -
j0no12/nero-optimizer-work-simo-lr0p001
Text Generation • Updated • 37 -
j0no12/nero-optimizer-work-simo-lr0p002
Text Generation • Updated • 37 -
j0no12/nero-optimizer-work-simo-lr0p003
Text Generation • Updated • 40 -
j0no12/nero-optimizer-work-simo-lr0p004
Text Generation • Updated • 41 -
j0no12/nero-optimizer-work-simo-lr0p006
Text Generation • Updated • 44 -
j0no12/nero-optimizer-work-simo-lr0p008
Text Generation • Updated • 46 -
j0no12/nero-optimizer-work-simow
Text Generation • Updated • 52 -
j0no12/nero-optimizer-work-simow-lr0p00025
Text Generation • Updated • 50 -
j0no12/nero-optimizer-work-simow-lr0p0005
Text Generation • Updated • 47 -
j0no12/nero-optimizer-work-simow-lr0p001
Text Generation • Updated • 53 -
j0no12/nero-optimizer-work-simow-lr0p002
Text Generation • Updated • 48 -
j0no12/nero-optimizer-work-stokes
Text Generation • Updated • 55