Xinference

Xorbits open-source distributed inference framework — one command serves any open-weight LLM, embedding, rerank, or multimodal model with OpenAI-compatible API.

View on AIWEBTOOLS.AI