6.3 Learning in Artificial Neural Networks
• Most implementations of the learning process also include a counterbalancing parameter called momentum to balance the learning rate. Essentially, whereas the purpose of the learning rate is to correct for the error, momentum is aimed at slowing the learning process. Many of the software programs available for neural networks can automatically select these parameters for the user or let the user experiment with many different combinations of such parameters.