Differences

This shows you the differences between two versions of the page.

--- data_mining:neural_network:types [2017/08/13 11:50] – [Recurrent NN] phreazer
+++ data_mining:neural_network:types [2019/10/26 12:09] (current) – ↷ Links adapted because of a move operation phreazer
@@ Line 1: / Line 1: @@
 ====== Types of NNs ======
+===== Perceptron =====
+See [[data_mining:neural_network:perceptron|Perceptron]]
 ===== Feed-forward NN =====
 First layer is input, last layer output, hidden layers inbetween.
@@ Line 13: / Line 14: @@
   * Harder to train
-Natural for modelling sequential data:
+Natural for modeling sequential data:
   * Equivalent to very deep nets with one hidden layer per time slice, except that they use same weights at every time sclice and get input at very time slice.
   * Can rember info in the hidden state for a long time.
+See [[data_mining:neural_network:sequences:sequence_learning|Sequence learning]]
 ===== Symmetrically connected NN =====
-Like RNN, but connections between units are symmetrical (same weigth in both directions).
+Like RNN, but connections between units are symmetrical (same weigths in both directions).
+  * Easier to analyze
+  * Restricted: Cannot model cycles
+  * "Hopfield nets" if they have no hidden layer.
-- Easier to analyze
+===== Convolutional NN =====
-- Restricted: Cannot model cycles
+See [[data_mining:neural_network:cnn:cnn|Convolutional neural network]]
-"Hopfield nets" if they have no hidden layer.