data_mining:neural_network:loss_functions

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Last revisionBoth sides next revision
data_mining:neural_network:loss_functions [2019/11/10 00:22] phreazerdata_mining:neural_network:loss_functions [2019/11/10 00:31] – [Binary cross entropy] phreazer
Line 38: Line 38:
  
 For an algo we need to find closes $p$ for $q$ by minimizing cross-entropy. For an algo we need to find closes $p$ for $q$ by minimizing cross-entropy.
 +
 +In training we have $N$ samples. For one particular example the distribution is known to which class it belongs. The loss function should minimize the average cross-entropy.
  • data_mining/neural_network/loss_functions.txt
  • Last modified: 2019/11/10 00:40
  • by phreazer