In a large bowl, combine the warm water, sugar, and yeast. Let sit for 5–10 minutes until foamy. Add the flour and salt, mixing until a shaggy dough forms. Cover and let rise until doubled in size.
While the dough rises, melt the butter in a saucepan over medium-low heat. Stir in the brown sugar, pumpkin purée, pumpkin pie spice, cinnamon, salt, and split vanilla bean. Cook for 3–5 minutes, stirring until smooth and glossy. Remove the vanilla bean and let the mixture cool slightly.
Transfer the dough to a generously greased 13x18-inch rimmed metal baking sheet. Stretch it gently toward the edges and let it rest if it resists.
Spread about ½ of the pumpkin spice mixture over the dough. Fold the dough over itself a few times to create layers of buttery cinnamon sugar, then gently stretch it back into the pan.
Cover and let rise again until noticeably puffy, about 30–45 minutes.
Preheat the oven to 375°F. Spoon the remaining pumpkin spice mixture over the dough, then dimple generously with your fingertips, working the filling into the surface.
Bake for 30–40 minutes, until golden brown and fully cooked through the center.
Whisk together the powdered sugar, milk, vanilla, and salt until smooth and thick but pourable. Let the focaccia cool for about 10–15 minutes, then drizzle the glaze generously over the top.
Slice, serve warm, and enjoy!
