This is an old revision of the document!
Perceptron
- Popularized by Frank Rosenblatt (1960s)
- Used for tasks with very big vectors of features
Decision Unit: Binary trheshold neuron.
Bias can be learned like weights, it's weight with value 1.
Perceptron convergence
- If output correct ⇒ no weight changes
- If output unit incorrectly outputs 0 ⇒ add input vector to weight vector.
- If output unit incorrectly outputs 1 ⇒ substract input vector from the weight vector.
This generates set of weights that gets the right answer for all training cases, if such a set exists. ⇒ Deciding the features is the important distinction