Preheat the oven to 350 degrees F (175 degrees C).
Arrange potatoes evenly in the bottom of a medium baking dish.
Mix together water, olive oil, lemon juice, garlic, bouillon cubes, thyme, rosemary, and pepper in a small bowl. Pour mixture over potatoes.
Cover and bake in the preheated oven, turning occasionally, until potatoes are tender yet firm, 1 ½ to 2 hours.
