PowerInfer

Category: AI Development & Platforms

SJTU open-source hybrid CPU/GPU LLM inference engine using hot/cold neuron split — 11x faster local inference on consumer GPUs.

Open PowerInfer →

Tags

Open Source · Inference · PowerInfer · Local AI · GPU · Hybrid · Self-Hosted · 18+ · Free · free tools · free ai tools · no cost

Similar AI tools in AI Development & Platforms

• Qwen3
• DeepSeek V3
• Mistral Large 2
• Phi-4
• Gemma 3
• Command R+
• Falcon 3
• Yi-Large
• OLMo 2
• Jan
• GPT4ALL
• Cherry Studio