Part 04 · LLM Internals
Project: Tiny GPT from Scratch
PyTorchSelf-attentionTraining loopSampling
A small decoder-only transformer in PyTorch, trained on a book on your own machine, that writes new text in its style. Every block from the last chapters, running together.
⏱ 6-8 hours · Station 32 of 92