WasmEdge

Category: AI Tools To Run LOCALLY

WebAssembly runtime for AI at the edge. Run LLMs and ML inference inside a tiny sandboxed Wasm container — cloud, IoT, and edge with security baked in.

Open WasmEdge →

Tags

Open Source · Edge AI · WebAssembly · Inference · Self-Hostable · CNCF · WasmEdge · Free · free tools · free ai tools · no cost

Similar AI tools in AI Tools To Run LOCALLY

• ExLlamaV2
• MLC LLM
• LMDeploy
• LocalRecall
• Neural Compressor
• Optimum
• AutoAWQ
• GPTQModel
• llm-awq
• BitsAndBytes
• Liger Kernel
• OpenVINO