Xinference

Xorbits open-source distributed inference framework — one command serves any open-weight LLM, embedding, rerank, or multimodal model with OpenAI-compatible API.
Tags
Open Source · Inference · Xinference · Distributed · OpenAI API · Self-Hosted · Free · free tools · free ai tools · no cost