Skip to content
Coding FodingcodingFoding(you: Human)
  • Careers
  • Pricing

Theme

Heading font

  1. Home
  2. AI & LLM Engineering
  3. Deep Learning
  4. Training Neural Networks

Part 03 · Deep Learning

Training Neural Networks

SGDMini-batchesAdamWeight initializationVanishing gradients

Gradient descent at scale: mini-batches, momentum and Adam, starting weights that don't kill the signal, and what exploding and vanishing gradients look like in a loss curve.

⏱ 1-2 hours · Station 18 of 92

171819
← Previous stopForward Pass and BackpropagationNext stop →Convolutional Neural Networks
Coding FodingcodingFoding(you: Human)

Everything you need, in one path.

Start free

Learn

  • Backend First Principles
  • DevOps & Cloud
  • System Design
  • AI & LLM Engineering
  • Database Internals
  • Frontend System DesignSoon

Practice

  • DSA problems
  • AI / ML problemsSoon
  • System Design Problems
  • Build to Hire

Interview

  • Interview PrepSoon
  • Most Common QuestionsSoon
  • Interview ExperiencesSoon
  • Success StoriesSoon

Community

  • Leaderboard
  • Blogs
  • Roadmap

More

  • Careers
  • Pricing

//codingFoding()

© 2026 Coding Foding · Made with ❤️ in Bangladesh

v1.0.0