First, time can’t go backwards so a fast clock can’t simply be changed back to an earlier time – imagine the complications of 2 files being compiled sequentially, but the clock change meaning the 2nd one is time stamped before the first one.
Normally changes to the time are introduced gradually by adding or taking from the interrupt interval.