There will be something you can do, but I have to say I'm unclear as to what exactly is happening - any chance you can post a photo? If not, what are the plants you're talking about and where are they planted? And do you live somewhere where there's mole activity?

if they are pushing up /out then carefully lift them and gently tease the outroots out of their 'spiral' ,replant to the correct depth and water well for about a week. unless it is raining stair rods! They will resettle, as a rule.

It sounds as if the plants were sold growing in peat and pot bound. As the roots have not made it out of the root ball they have not anchored themselves in the surrounding soil, are being rocked in the wind and this is lifting them. What you need to do now Mayajin, is to lift the plants and tease out the roots whilst holding them in a bowl of water. Use the water to wash away as much of the peat as possible and free up the roots. We always do this with plants before we plant them anyway as the roots can be reluctant to grow away from the peat.

it might also be worth to redig the holes half as big again so there is loose soil to plant back into.