Melt the butter in a small sauce pan over low heat. Add the cocoa, stir until the mixture is smooth and thick. Remove the pan from the heat and place the cocoa mixture into a medium size bowl. Let it cool slightly.
Add the milk and vanilla alternately with the powdered sugar to the bowl and beat with an electric mixer or whisk until you have the spreading consistency you desire.