data_mining:logistic_regression

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
data_mining:logistic_regression [2018/05/10 15:45] – [Regularization] phreazerdata_mining:logistic_regression [2018/05/10 15:48] (current) – phreazer
Line 73: Line 73:
  
 $min \dots + \lambda \sum_{i=1}^n \theta_j^2$ $min \dots + \lambda \sum_{i=1}^n \theta_j^2$
- 
- 
-For large $\lambda$, $W^{[l]} => 0$ 
- 
-$J(W^{[l]},b^{[l]})= \frac{1}{m} \sum_{i=1}^m J(\hat{y}^{(i)}, y^{(i)}) + \frac{\lambda}{2m} \sum_{l=1}^L || W^{[l]} ||^2$ 
- 
-This results in a **simpler** network / each hidden unit has **smaller effect**. 
- 
-Another effect, wehn $W$ is small, $z$ has a smaller range, resulting activation e.g. for tanh is more linear. 
  
 === Gradient descent (Linear Regression) === === Gradient descent (Linear Regression) ===
  • data_mining/logistic_regression.1525967130.txt.gz
  • Last modified: 2018/05/10 15:45
  • by phreazer