Bake the rest of the cupcakes. If your test cupcake overflowed,don’t put as much batter in the others. Start checking for doneness at around the number of minutes it took for the test cupcake to bake. Cool the cupcakes. Finally, Remove the cupcakes from their tins and set them on a cooling rack to cool completely. Cooling the cupcakes in the tins can cause the liners to fall away from the cake.