I don't think "time limit" refers to how quickly you beat him after he shows up, but how long you take getting him to show up in the overall stage time. I don't know the exact numbers but it's probably something like you have to get him to show up and beat him within 10 minutes of starting the stage.