Finally we conclude with observations on how this investigation has impacted our understanding of diversity in general, and note several possible new directions that are suggested
by this work. This includes links to evolutionary computation, Mixtures of Experts, and
regularisation techniques.