Place room temperature unsalted butter and creamy peanut butter in a mixing bowl. Use an electric mixer on medium and beat the butter for 1 minute, until whipped and fluffy.
Add in the powdered sugar and vanilla extract, beat again on low for 1-2 minutes, scraping down the sides of the bowl, until everything is incorporated.
If the frosting is too thick, add a tablespoon of milk or heavy cream, and beat until creamy. Spread or pipe onto cake, cupcakes, or brownies.
