Part 09 · Fine-tuning and Serving Models

LoRA and QLoRA

Training a few million weights instead of billions: low-rank adapters, doing it on a 4-bit base model with QLoRA, and swapping adapters at serve time.

⏱ 1-2 hours · Station 72 of 92