This is an old revision of the document!
Perceptron
- Popularized by Frank Rosenblatt (1960s)
- Used for tasks with very big vectors of features
Decision Unit: Binary trheshold neuron.
Bias can be learned like weights, it's weight with value 1.
Perceptron convergence
- If output correct ⇒ no weight changes
- If output unit incorrectly outputs 0 ⇒ add input vector to weight vector.
- If output unit incorrectly outputs 1 ⇒ substract input vector from the weight vector.
This generates set of weights that gets the right answer for all training cases, if such a set exists. ⇒ Deciding the features is the important distinction
Geometrical Interpretation
Weight space
- 1 dimensions for each weight
- Point represents setting of all weights
- Leaving the threshold out, each training case can be represented as a hyperplane through the origin.
- Weights must lie on one side of this hyper-plane to get the answer correct.