Geometrically, the covariance matrix specifies an ellipsoid that circumscribes the primary dimensions of the data in N space (N being the dimension of the data). Outlier data stretches the ellipsoid along the axis of the outlier relative to the mean. Here is a diagram from a paper by Hubert and Verboven that illustrates this nicely: