SGLang Framework
Fast serving framework for LLMs and vision-language models — 5x throughput over vLLM in benchmarks.
Tags
Open Source · Free · Local · Self-Hostable · Offline · 2026 · SGLang Framework · open source ai · free ai tool · local ai · local model · privacy