Preheat the oven to 400°F.
In a small skillet or other shallow, oven-safe dish, stir together the beans, olives, garlic, paprika, and salt. Pour the oil over the mixture and gently stir to combine. Transfer to the oven and bake for 30 minutes. I don’t stir, as I like the chewy crust that forms on the beans at the surface, but you can stir once or twice as it bakes if you prefer a more uniform consistency.
These are best served hot or warm, garnished with the dried oregano. Leftovers can be stored in an airtight container, where they’ll continue to marinate for up to 3 days. Bring to room temperature, or warm, before serving.
