The last two lines confirm this. If the lovers move from noon, or constant light, they will be walking back into the shadows and basically its all down hill from there. What's the point of shedding light on the relationship during the morning, to run back into the shadows in the afternoon. It might as well be night and the relationship might as well be over.