Home / Open-source AI / vllm
vllm
by vllm-project
A high-throughput and memory-efficient inference and serving engine for LLMs
GitHub stars97.3K
Forks25.1K
7d change–
LanguagePython
LicenseApache-2.0
Last commit22 Nov 2026