Pale Servitor Auto Asign

I'm on PS5 and I bought the Scourge Commander Cosmetic that allow to summon Pale Servitor Pets , the skill auto-bind itself to x (on ps5) on my skillbar wich is annoying sinch I use it to pick up and interact with object! I tried to remove the skill from the tollbar or bind it somewhere else on the bar but the skill alway reappear on the x In the skillbar.