If the caps are omitted, the regulator may not be stable. In tests of random samples of 78xx regulators, I have observed some oscillating at several MHz without the stabilizing capacitors. Adding caps of the recommended values stopped the oscillations.