Auto-GPTQ

Easy-to-use LLM quantization package based on GPTQ — 4-bit weights, tiny memory footprint.