At the other extreme are fully distributed networks where there is considerable
interaction among representations. This interaction is responsible for the networks'
ability to generalize. However, these networks can be severely affected by
catastrophic forgetting