AI-SOVEREIGN
Home / Open-source AI / omlx
Open-source AI

omlx

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

GitHub stars23.8K
Forks2.2K
7d change–
LanguagePython
LicenseApache-2.0
Last commit22 Nov 2026
apple-siliconinference-serverllmmacosmlxopenai-api

More from jundot