AI-SOVEREIGN
Home / Open-source AI / inference
Open-source AI

inference

Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.

GitHub stars9.7K
Forks902
7d change–
LanguagePython
LicenseApache-2.0
Last commit21 Nov 2026
artificial-intelligencediffusersgemmaglmglm-5-3inferencekimikimi-k3