Differences

This shows you the differences between two versions of the page.

--- data_mining:neural_network:types [2017/01/15 18:19] – phreazer
+++ data_mining:neural_network:types [2019/10/26 12:09] (current) – ↷ Links adapted because of a move operation phreazer
@@ Line 1: / Line 1: @@
 ====== Types of NNs ======
+===== Perceptron =====
+See [[data_mining:neural_network:perceptron|Perceptron]]
 ===== Feed-forward NN =====
 First layer is input, last layer output, hidden layers inbetween.
@@ Line 10: / Line 11: @@
 ===== Recurrent NN =====
-- Directed cycles (you can get back to the neurons where you start).
+  * Directed cycles (you can get back to the neurons where you start).
-- Harder to train
+  * Harder to train
-Natural for modelling sequential data:
+Natural for modeling sequential data:
-- Equivalent to very deep nets with one hidden layer per time slice, except that they use same weights at every time sclice and get input at very time slice.
+  * Equivalent to very deep nets with one hidden layer per time slice, except that they use same weights at every time sclice and get input at very time slice.
-- Can rember info in the hidden state for a long time.
+  * Can rember info in the hidden state for a long time.
+See [[data_mining:neural_network:sequences:sequence_learning|Sequence learning]]
 ===== Symmetrically connected NN =====
-Like RNN, but connections between units are symmetrical (same weigth in both directions).
+Like RNN, but connections between units are symmetrical (same weigths in both directions).
+  * Easier to analyze
+  * Restricted: Cannot model cycles
+  * "Hopfield nets" if they have no hidden layer.
-- Easier to analyze
+===== Convolutional NN =====
-- Restricted: Cannot model cycles
+See [[data_mining:neural_network:cnn:cnn|Convolutional neural network]]
-"Hopfield nets" if they have no hidden layer.