Delta rule

Delta Rule
Also known by the names:
Adaline Rule
Widrow-Hoff Rule
Least Mean Squares (LMS) Rule ...

Delta Rule The perceptron learning rule that specifies that weight changes should be proportional to the product of a weight's input and the error (or delta) term for the perceptron.

Delta Rule
Since we are now using units with nonlinear activation functions, we have to generalise the delta rule:
The activation is a differentiable function of the total input, given by ...

delta rule The delta rule in error backpropagation learning specifies the update to be made to each weight during backprop learning.

The Delta Rule
It is fairly self-evident that training the perceptron requires modifying its weights.

The delta rule- this is basically an error correction learning rule. It is one of the most commonly used.

Delta rule
Wolfe conditions
[edit] References
Mordecai Avriel (2003). Nonlinear Programming: Analysis and Methods. Dover Publishing. ISBN 0-486-43227-0.
Jan A. Snyman (2005).

Back-Propagated Delta Rule Networks (BP) (sometimes known and multi-layer perceptrons (MLPs)) and Radial Basis Function Networks (RBF) are both well-known developments of the Delta rule for single layer networks (itself a development of the ...

Biased feedback in spatial recall yields a violation of delta rule learning. Psychonomic Bulletin & Review
...

See also: Neural network, Perceptron, Percept, Artificial neural network, AI