If you are working right now, then just be frank to me that you are working. When I asked you: “Can you start work on 1st December?” Why did you answer me yes?
You scare that your impression will be damaged by the references, then what about your impression to Xerox – your incoming employer? We want staff who are able to speak the truth instead of promise first, then unable to deliver the result.