CTranslate2

Category: AI Development & Platforms · Free to use

Open-source fast inference engine for Transformer models in C++ with Python bindings — 2-4x faster than PyTorch with quantization, batching, and CPU/GPU support.

Open CTranslate2 →

Tags

Open Source · Inference · C++ · Fast · Quantization · Free · Self-Hostable · 18+ · CTranslate2 · free tools · free ai tools · no cost

Similar AI tools in AI Development & Platforms

• Qwen3
• DeepSeek V3
• Mistral Large 2
• Phi-4
• Gemma 3
• Command R+
• Falcon 3
• Yi-Large
• OLMo 2
• Jan
• GPT4ALL
• Cherry Studio