Nitro Local Inference

Category: AI Development & Platforms · Free to use

Fast, lightweight inference engine (3MB binary) that wraps llama.cpp with an OpenAI-compatible API for edge deployment.

Open Nitro Local Inference →

Tags

Open Source · Free · Local · Self-Hostable · Offline · 2026 · Nitro Local Inference · open source ai · free ai tool · local ai · local model · privacy

Similar AI tools in AI Development & Platforms

• Qwen3
• DeepSeek V3
• Mistral Large 2
• Phi-4
• Gemma 3
• Command R+
• Falcon 3
• Yi-Large
• OLMo 2
• Jan
• GPT4ALL
• Cherry Studio