can't interact with objects after trying controller input

Bug Report Reference: 471.830.240

After trying out controller Input for a session I can't interact with objects anymore. I can still talk to NPCs.

It always priotizes to do my attack Staggering Palm on leftclick. When i unbind the skill i can interact again. Upon rebinding my skill to leftclick i cant interact anymore. I've tried multiple times to Check/uncheck the "always priotize interact over attack" or whatever in the Menu. Tried defaulting my Inputs, tried Changing Screen Options. Tried switching back and forth from controller again. Restarted PoE2 multiple times.

Running out of ideas on what to do here. Would like to keep the skill on leftclick...

An Idea might be to enable "Interact" rebinding on Mouse+Keyboard as well as on controller.