they look like suckers from a nearby cherry tree or similar.
Do you have a cherry?

Unfortunately they are difficult to eradicate, you need to expose the root where they are coming from and remove them. The tree is likely to send up more over time I am afraid.

Yes I do have a lovely old cherry tree in the back of the lawn. Thank you for your answer, not what I thought it might be, thank heavens!