data_mining:neural_network:neurons

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
data_mining:neural_network:neurons [2017/08/19 15:42] – [Rectified Linear Neurons] phreazerdata_mining:neural_network:neurons [2017/08/19 15:43] (current) – [Rectified Linear Neurons] phreazer
Line 80: Line 80:
  
 Faster computation, since slope doesn't get very small/large. Faster computation, since slope doesn't get very small/large.
 +
 +Leaky ReLU:
 +
 +$y =\max(0.01 z,z)$
  
  
  • data_mining/neural_network/neurons.1503157364.txt.gz
  • Last modified: 2017/08/19 15:42
  • by phreazer