In a large bowl, with an electric mixer on medium, beat together butter and 1/2 cup sugar until light and fluffy, about 3 minutes. Scrape down sides of bowl, then beat in vanilla extract and the whole egg. Scrape down sides of bowl again, then beat in egg yolk. With the mixer on low, beat in half the flour mixture, followed by the milk, and then the remaining flour mixture.