Sift the confectioners' sugar followed by unsweetened cocoa in a large bowl, to get rid of any lumps.
Stir in the powdered milk and whisk well until everything is combined.
Add mini marshmallows to the container, if desired. This can be kept in the pantry for 6 months.
