Ui Menu Bar Skill placement bug

When I put a staff in my weapon slot 2 it gives me the skill in my menu bar. It defaults at my X button (on ps5). I place it somewhere else because I dont want it on my X (i use X soly as interact button) but when I got through a portal its back at the X every single time. I have a feeling it has to do with shapeshifting since Im almost always a bear and when you port it makes you human again.

Would be nice if its fixed since I dies already once because of this and I hate replacing the skill every map entry.