vLLM

Category: AI Chat Assistants · Free to use

High-throughput inference engine for LLMs with PagedAttention. Serve open models on your own GPUs at production scale.

Open vLLM →

Tags

Open Source · Free · Local · Self-Hostable · Offline · 2026 · vLLM · vllm · open source ai · free ai tool · local ai · local model

Similar AI tools in AI Chat Assistants

• AnythingLLM
• Open WebUI
• Msty
• LocalAI
• Ollama
• LM Studio
• Text Generation WebUI
• KoboldCpp
• llama.cpp
• PrivateGPT
• Msty Studio
• BoltAI