Home / Open-source AI / PowerInfer
PowerInfer
by Tiiny-AI
High-speed Large Language Model Serving for Local Deployment
GitHub stars9.9K
Forks622
7d change–
LanguageC++
LicenseMIT
Last commit11 May 2026