AI-SOVEREIGN
Home / Open-source AI / FlexLLMGen
Open-source AI

FlexLLMGen

Running large language models on a single GPU for throughput-oriented scenarios.

GitHub stars9.3K
Forks589
7d change–
LanguagePython
LicenseApache-2.0
Last commit28 Oct 2024
deep-learninggpt-3high-throughputlarge-language-modelsmachine-learningoffloadingopt