It happens sometimes - often towards the end of the potato plant's growing season, or as an effect of excessive fertilizer, but mostly the flowers just fall off and don't form fruit. Although they look like tomatoes, don't eat them, they're not edible. They won't affect your potato tubers, but if you have children around, remove the fruits so they're not tempted to pick and eat them.

I would off them so the plant can focus energy only on potatoes.

Not only not edible, but actually poisonous. The will eventually ripen to look like tomatoes. After all potatoes and tomatoes are in the same family.

Potato breeders use the seeds that they produce to make new varieties--that's how Luther Burbank got his start--but only one out of a thousand seedlings are worth keeping.