It is due to the
catastrophic forgetting problem that most ANN learning
algorithms are based on “concurrent” learning, i.e. the whole
population of interest is presented and trained as a single,
complete entity. Training is then “finished” and no further
information is learned by the network.