SGLang Framework
Fast serving framework for LLMs and vision-language models — 5x throughput over vLLM in benchmarks.
View on AIWEBTOOLS.AI