AI-SOVEREIGN
Home / Open-source AI / Sophia
Open-source AI

Sophia

The official implementation of “Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training”

GitHub stars1K
Forks56
7d change–
LanguagePython
LicenseMIT
Last commit30 Jan 2024
deep-learninglarge-language-modelsoptimizer