Set oven to 400°F (200°C).
Rinse and thoroughly dry the baby potatoes.
Combine potatoes with olive oil, garlic, rosemary, salt, and pepper in a bowl.
Spread potatoes on a rimmed baking sheet in a single layer.
Bake for about 20 minutes, shaking every 5 minutes for even browning.
Potatoes should be crisp outside and fork-tender inside.
Remove from oven, season to taste, and serve hot.
