Differences
This shows you the differences between two versions of the page.
| Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
| data_mining:neural_network:short_overview [2018/04/22 00:19] – [Backpropagation Algorithm] phreazer | data_mining:neural_network:short_overview [2018/05/10 17:32] (current) – [Cost function] phreazer | ||
|---|---|---|---|
| Line 96: | Line 96: | ||
| * Sum over k: number of outputs | * Sum over k: number of outputs | ||
| * Sum over all $\theta_{ji}^{(l)}$ without bias units. | * Sum over all $\theta_{ji}^{(l)}$ without bias units. | ||
| + | * Frobenius norm for regularization, | ||
| ===== Backpropagation Algorithm ===== | ===== Backpropagation Algorithm ===== | ||
| Line 132: | Line 133: | ||
| Algorithmus | Algorithmus | ||
| - | $$\Delta_{ij}^{(l)} = 0 \text{für alle i,j,l} \\ | + | $$\text{Set } \Delta_{ij}^{(l)} = 0 \text{ |
| \text{For i=1 to m:} \\ | \text{For i=1 to m:} \\ | ||
| - | \text{Set} a^{(1)} = x^{(i)}$$ | + | \text{Set } a^{(1)} = x^{(i)}$$ |
| Forward propagation to compute $a^{(l)}$ für $l=2, | Forward propagation to compute $a^{(l)}$ für $l=2, | ||