Decision boundary

Decision Boundary
The training process makes the network to define its decision boundaries.

Note that the decision boundary of a perceptron is invariant with respect to scaling of the weight vector, i.e.

And we might have a curved decision boundary. We might have a hyperplane which might exactly separate the data but this may not be desirable if the data has noise in it.

Before updating the weight W, we note that both p1 and p2 are incorrectly classified (red dashed line is decision boundary). Suppose we choose p1 to update the weights as in picture below on the left.

The boundary between two decision regions is a decision boundary. Its shape is determined by both : ...

See also: Classification, Perceptron, Percept, Neural network, Machine learning