Part 03 · Deep Learning
Training Neural Networks
SGDMini-batchesAdamWeight initializationVanishing gradients
Gradient descent at scale: mini-batches, momentum and Adam, starting weights that don't kill the signal, and what exploding and vanishing gradients look like in a loss curve.
⏱ 1-2 hours · Station 18 of 92