Preheat the oven to 350℉ (177℃). Prepare an 8×8 inch baking pan with nonstick cooking spray and parchment paper. Cut the parchment paper so that it extends up past the sides of the pan.
In a medium mixing bowl, whisk together the all-purpose flour, baking powder, and salt. Set aside.
In the bowl of a stand mixer fitted with a paddle attachment or in a large bowl with an electric hand mixer, cream the unsalted butter and granulated sugar for a few minutes until smooth and creamy. Add in the egg, milk, vanilla extract, and almond extract and mix until the mixture is well combined and smooth.
Add the dry ingredients into the butter mixture and mix on low speed until a soft cookie dough forms.
Spread the sugar cookie dough into the prepared baking pan to create an even layer of cookie dough.
Bake the sugar cookie bars for 25 to 28 minutes until they are light golden-brown around the edges and puffed up in the center. Cool the cookie bars in the pan to room temperature while you are making the vanilla cream cheese frosting.
In the bowl of a stand mixer fitted with a paddle attachment or in a large bowl with an electric hand mixer, cream the unsalted butter and cream cheese on medium speed for 5 minutes until smooth and creamy.
Add in the powdered sugar and mix on low speed until combined with the cream cheese mixture. Add in the heavy cream, vanilla extract, and salt and continue to mix on low speed.
Increase the speed on the mixer to medium and whip the frosting for about 2 to 3 minutes until it is smooth and creamy. Turn the mixer to low speed and mix the frosting for several minutes to remove any air bubbles.
Optional: To smooth out the frosting and remove any air bubbles, heat ½ cup of the frosting in the microwave for 15 seconds. Pour the melted frosting back into the mixing bowl and mix on low speed until the frosting is super smooth and creamy.
Once the sugar cookie bars are completely cooled, spread a thick layer of the vanilla cream cheese frosting onto the bars in an even layer using an offset spatula. Decorate the bars with colorful nonpareil sprinkles or your favorite sprinkle variety.
Cut the bars into 16 squares. To make clean cuts, chill the cookie bars in the refrigerator for 30 to 60 minutes before cutting.
