Xorbits Inference
Xorbits Inference (Xinference) — open framework for serving LLMs, embeddings and multimodal models with one command. OpenAI-compatible API.
Tags
Open Source · Free · Local · Self-Hostable · Offline · 2026 · Xorbits Inference · xorbits inference · open infra · AI Development Tools · open source ai · free ai tool