Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revision | Last revisionBoth sides next revision | ||
data_mining:neural_network:loss_functions [2019/11/10 00:22] – phreazer | data_mining:neural_network:loss_functions [2019/11/10 00:31] – [Binary cross entropy] phreazer | ||
---|---|---|---|
Line 38: | Line 38: | ||
For an algo we need to find closes $p$ for $q$ by minimizing cross-entropy. | For an algo we need to find closes $p$ for $q$ by minimizing cross-entropy. | ||
+ | |||
+ | In training we have $N$ samples. For one particular example the distribution is known to which class it belongs. The loss function should minimize the average cross-entropy. |