Place the potatoes in a large pot and cover with cold water. Bring to a boil and boil for 10 to 12 minutes, or until the potatoes are fork tender.
While the potatoes boil, make the dressing. Whisk together the vinegar, shallots, capers, lemon juice, zest, garlic and a big pinch of salt and pepper. Whisk in the olive oil until emulsified.
Drain the potatoes when tender and let cool. Gently slice them in half. Drizzle with the piccata vinaigrette. Add in more capers if you wish. Add in the fresh herbs and toss again. Toss a few more times to make sure everything is combined. Sprinkle on the parmesan cheese and toss again before serving. Taste and season with more salt and pepper if needed.
