Modelling validation of new MaMMUT2 (fixed pooling) + NaFlex / ModernText architecture changes in OpenCLIP. All runs across 32 epochs of CC12M
-
rwightman/mammut2-moderntext_ViT-B-32.cc12m-qk-lr2e3-b4096
Zero-Shot Image Classification • Updated • 11 -
rwightman/mammut2-moderntext_ViT-B-32.cc12m-qk-lr2e3
Zero-Shot Image Classification • Updated • 20 -
rwightman/mammut2-moderntext_ViT-B-32.cc12m-qk-lr3e3
Zero-Shot Image Classification • Updated • 28 -
rwightman/mammut2-moderntext_ViT-B-32.cc12m-noqk-lr1e3
Zero-Shot Image Classification • Updated • 21