Using a mixer with a paddle attachment, beat the butter on high speed until creamy, about 1 minute. Scrape down the sides and the bottom of the bowl as needed. Switch the mixer to medium speed and beat in the brown and white sugars until combined. Beat in the egg, milk and vanilla extract, scraping down the sides and bottom of the bowl as needed.