FlexGen

Category: AI Development & Platforms · Free to use

High-throughput generative inference of LLMs on a single commodity GPU — run OPT-175B on a 16GB card.

Open FlexGen →

Tags

Open Source · Free · Local · Self-Hostable · Offline · 2026 · FlexGen · open source ai · free ai tool · local ai · local model · privacy

Similar AI tools in AI Development & Platforms

• Qwen3
• DeepSeek V3
• Mistral Large 2
• Phi-4
• Gemma 3
• Command R+
• Falcon 3
• Yi-Large
• OLMo 2
• Jan
• GPT4ALL
• Cherry Studio