Combine the peanut butter, powdered sugar, and vanilla in a large bowl and beat with an electric mixer until smooth and creamy.
Add the milk one tablespoon at a time, beating continuously. When the glaze reaches the consistency you desire, pour or drizzle it over the cooled cake.
