Regularization

One way to prevent Overfitting is to prevent the Backpropagation from selecting weigths that totally ignore parts of the feature vector.

Example:

Both weight vectors and will produce the same output multipled with , however the