# Differences

This shows you the differences between two versions of the page.

Both sides previous revision Previous revision | Last revision Both sides next revision | ||

data_mining:neural_network:loss_functions [2019/11/10 00:22] phreazer |
data_mining:neural_network:loss_functions [2019/11/10 00:31] phreazer [Binary cross entropy] |
||
---|---|---|---|

Line 38: | Line 38: | ||

For an algo we need to find closes $p$ for $q$ by minimizing cross-entropy. | For an algo we need to find closes $p$ for $q$ by minimizing cross-entropy. | ||

+ | |||

+ | In training we have $N$ samples. For one particular example the distribution is known to which class it belongs. The loss function should minimize the average cross-entropy. |