Generalisation is based on smooth interpolations (and, less
reliably, extrapolations) of and between training data points
in the function learned by the network. We might expect,
therefore, that restricting changes to the function to areas
which are local to each new item learned will have a
detrimental effect on the ability of the network to generalise.
The main focus of this paper is to undertake an initial
investigation of this hypothesis.