AI-SOVEREIGN
Home / Open-source AI / PowerInfer
Open-source AI

PowerInfer

High-speed Large Language Model Serving for Local Deployment

GitHub stars9.9K
Forks622
7d change–
LanguageC++
LicenseMIT
Last commit11 May 2026
large-language-modelsllamallmllm-inferencelocal-inference