TensorRT-LLM

Category: AI Development & Platforms · Free to use

NVIDIA's toolkit for defining optimized LLM engines with quantization and multi-GPU inference at max speed.

Open TensorRT-LLM →

Tags

Open Source · Free · Local · Self-Hostable · Offline · 2026 · TensorRT-LLM · open source ai · free ai tool · local ai · local model · privacy

Similar AI tools in AI Development & Platforms

• Qwen3
• DeepSeek V3
• Mistral Large 2
• Phi-4
• Gemma 3
• Command R+
• Falcon 3
• Yi-Large
• OLMo 2
• Jan
• GPT4ALL
• Cherry Studio