Make the frosting. You can do this while the cupcakes are cooking. To make the frosting, just cream 2 sticks of softened butter, 3 cups of confectioners' sugar, 1/2 cup of milk, and 2 tsp. of vanilla extract together. Beat the mixture with a paddle until it's smooth and gradually add the other 3 cups of sugar until it's rich and creamy.