If you wish to collect seed, you can leave them until they are dry and brown and then the seeds will come out as from a pepper pot. If not, they can be removed after flowering, but I think they are pretty and tend to leave them on for a time.

I leave them as they are so decorative, but if you don't want them self-seeding, cut them off once the bloom has gone.