data_mining:neural_network:loss_functions

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Last revision Both sides next revision
data_mining:neural_network:loss_functions [2019/11/10 00:22]
phreazer
data_mining:neural_network:loss_functions [2019/11/10 00:31]
phreazer [Binary cross entropy]
Line 38: Line 38:
  
 For an algo we need to find closes $p$ for $q$ by minimizing cross-entropy. For an algo we need to find closes $p$ for $q$ by minimizing cross-entropy.
 +
 +In training we have $N$ samples. For one particular example the distribution is known to which class it belongs. The loss function should minimize the average cross-entropy.
  • data_mining/neural_network/loss_functions.txt
  • Last modified: 2019/11/10 00:40
  • by phreazer