This is an old revision of the document!
NN initialization
Random initialization
Weights need to be randomly initialized. For bias zero is ok.
If weights are zero: in backprop ⇒ $dz_{1,2}$ are the same. Hidden units would compute same function.
- data_mining/neural_network/initialization.1503174878.txt.gz
- Last modified: 2017/08/19 22:34
- by phreazer