LLM Compressor

Neural Magic open library for quantizing and compressing LLMs for vLLM deployment.