Xorbits Inference (Xinference) — open framework for serving LLMs, embeddings and multimodal models with one command. OpenAI-compatible API.