Remove the grapefruit peel and pith with a serrated knife, then separate each grapefruit into segments with a paring knife, discarding the membranes between each segment.
Put the olives, olive oil and rosemary in a food processor; season with black pepper. Process until the olives are almost fully puréed. Top the grapefruit segments with the olive purée and serve immediately.
