Home / Open-source AI / FlexLLMGen
FlexLLMGen
by FMInference
Running large language models on a single GPU for throughput-oriented scenarios.
GitHub stars9.3K
Forks589
7d change–
LanguagePython
LicenseApache-2.0
Last commit28 Oct 2024