Harvest plots at random are impossible to interact with

This happens at complete random, but occasionally a Harvest plot cannot be interacted with. You can click on the button to start it but all you do is walk over to the plot. The opposing plot can be interacted with just fine every time, though.

Lost so many good plots cause they just aren't allowed to be touched.