llama.cpp

Category: AI Chat Assistants · Free to use

Georgi Gerganov's legendary C/C++ port of LLaMA inference. Powers most local LLM tools on the planet — CPU/GPU, GGUF, quantization, and full offline operation.

Open llama.cpp →

Tags

Open Source · Free · Local · Self-Hostable · Offline · 2026 · llama.cpp · llama-cpp · open source ai · free ai tool · local ai · local model

Similar AI tools in AI Chat Assistants

• AnythingLLM
• Open WebUI
• Msty
• LocalAI
• Ollama
• LM Studio
• Text Generation WebUI
• KoboldCpp
• vLLM
• PrivateGPT
• Msty Studio
• BoltAI