Parameter-Efficient Fine-Tuning by HuggingFace. LoRA, QLoRA, prefix-tuning, IA3 — train massive LLMs on consumer hardware by updating only a tiny fraction of parameters.