You can remove the dead flower spires if you wish, let the foliage die back naturally - it will all disappear within a few weeks.

And don't forget to collect some seeds!

And if you want more collect the seeds or if you want the cottage garden look with them popping up all around that area then one method is to bend over the stalks with the seedheads and that will help them drop their seeds nearby