Stop 07 · Deep Learning FoundationsTopics · 9/11

Batch Normalization

Part of the AI Engineer Roadmap

In short

A technique that normalizes layer inputs during training, stabilizing and speeding up convergence in deep networks.

How to learn this

  1. 1Train a deep network with and without batch norm and compare training stability.
  2. 2Learn where batch norm layers are typically placed relative to activations.
  3. 3Understand the difference in batch norm behavior between training and inference mode.

More topics at this stop

Stuck on this topic? Ask an Insider

Get 1:1 guidance from people who've walked this exact path — on the InsideEdge app.

Download
InsideEdge