Squeeze juice or puree one peach. Add to brandy/cognac and let rest for 15-20 minutes in separate bowl/measuring cup.
Slice lime, lemons, and remaining peaches. Pour white wine over fruit. Add brandy/cognac and sugar. Stir briskly with whisk or spoon.
Add ginger beer before serving, or leave out if it's not your deal.