Home / Open-source AI / Sophia
Sophia
by Liuhong99
The official implementation of “Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training”
GitHub stars1K
Forks56
7d change–
LanguagePython
LicenseMIT
Last commit30 Jan 2024