Sounds like Lords and Ladies ,or Cuckoo Pint, depending on the local vernacular - Arum I think its really called- about 6 inches high, with red berries on a thick stem? Yes, poisonous too.

Any chance of a photo at all please? It may be easier to answer your question...

Sounds like Arum maculatum fruits. Well, they are poisonous, but there have been no reported deaths from eating them for over 200 years. You need to eat a few and the reports are that no one has ever managed to eat even one. The sensation is supposed to be like chewing needles.

Attractive and interesting plant so leave it. The leaves and flowers would have been earlier, March-June then after these die away, the flower stalk remains eventually developing the berries. There is also Arum italicum 'Pictum' seen as ornamentals in wilder gardens which is also another candidate.