MLC LLM

Category: AI Tools To Run LOCALLY

Universal LLM deployment by CMU + Apache TVM. Compiles models to run natively on iPhone, Android, WebGPU, Vulkan, Metal, and AMD — anywhere, fully offline.

Open MLC LLM →

Tags

Open Source · Local AI · Edge AI · Mobile · WebGPU · Self-Hostable · Cross-Platform · MLC LLM · Free · free tools · free ai tools · no cost

Similar AI tools in AI Tools To Run LOCALLY

• ExLlamaV2
• WasmEdge
• LMDeploy
• LocalRecall
• Neural Compressor
• Optimum
• AutoAWQ
• GPTQModel
• llm-awq
• BitsAndBytes
• Liger Kernel
• OpenVINO