Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revision | |||
data_mining:neural_network:tuning [2018/05/20 15:20] – [Why does it work] phreazer | data_mining:neural_network:tuning [2018/05/20 15:21] (current) – [Batch norm at test time] phreazer | ||
---|---|---|---|
Line 261: | Line 261: | ||
Here no mini-batch, but one sample at a time | Here no mini-batch, but one sample at a time | ||
+ | Estimate $\sigma^2, \mu$ using exponentially weighted average across mini-batches |