Home / Open-source AI / omlx
omlx
by jundot
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
GitHub stars23.8K
Forks2.2K
7d change–
LanguagePython
LicenseApache-2.0
Last commit22 Nov 2026