LLM Compressor
Neural Magic open library for quantizing and compressing LLMs for vLLM deployment.
Tags
Open Source · Free · Local · Self-Hostable · Offline · 2026 · LLM Compressor · open source ai · free ai tool · local ai · local model · privacy
Neural Magic open library for quantizing and compressing LLMs for vLLM deployment.
Open Source · Free · Local · Self-Hostable · Offline · 2026 · LLM Compressor · open source ai · free ai tool · local ai · local model · privacy