Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training Paper • 2305.14342 • Published May 23, 2023 • 1
