Ignore them, I do, they do no harm and will be gone quite quickly.

I previously answered a question that someone posted about toadstools in their lawn, and I think the answer is the same:

As far as I'm aware there are no fungicides available in the UK that are effective against fungi. However, since they are not damaging to the turf, and are part of a natural and temporary process and even beneficial for your lawn there is no need to treat them. In fact it's a sign of a healthy lawn.

Breaking the stems by brushing them will cause them to dry out and disappear, they are composed mainly of water.

They are not damaging to the turf and are a temporary problem.

As regards to mushrooms, if you are 100% sure that they are edible then harvest them while you can and be thankful for the unexpected crop :)