Learning representations by back-propagating errors(opens in a new tab)
Backpropagation for networks with hidden units: run the input forward, pass the error derivative backward through each layer with the chain rule to get the gradient for every weight, and adjust the weights by gradient descent. The hidden units learn useful internal features on tasks such as detecting symmetry and learning family relationships.