Part 04 · LLM Internals
Pretraining and Fine-tuning
Next-token predictionPretrainingInstruction tuningRLHFDPO
From guessing the next word on the internet to following instructions: pretraining, instruction tuning, and preference training with RLHF and DPO.
⏱ 1-2 hours · Station 28 of 92