AWQ Quant
Activation-aware weight quantization for LLMs — high-quality 4-bit inference.
Tags
Open Source · Free · Local · Self-Hostable · Offline · 2026 · AWQ Quant · open source ai · free ai tool · local ai · local model · privacy
Activation-aware weight quantization for LLMs — high-quality 4-bit inference.
Open Source · Free · Local · Self-Hostable · Offline · 2026 · AWQ Quant · open source ai · free ai tool · local ai · local model · privacy