AI-SOVEREIGN
Home / Open-source AI / vllm
Open-source AI

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

GitHub stars97.3K
Forks25.1K
7d change–
LanguagePython
LicenseApache-2.0
Last commit22 Nov 2026
amdblackwellcudadeepseekdeepseek-v3gptgpt-ossinference

More from vllm-project