LOMO Optimizer

Full-parameter fine-tuning of 65B LLMs on 8×RTX 3090 using low-memory optimizer.