Home / Open-source AI / inference
inference
by xorbitsai
Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.
GitHub stars9.7K
Forks902
7d change–
LanguagePython
LicenseApache-2.0
Last commit21 Nov 2026