Lv 20 monk - skeletal warrior reserving spirit

Hi,
I'm having problems with my monk when weilding my quarter staff it shows 0 spirit.
In early game I was experimenting with minions and now every scepter grants skeletal warrior and its cutting my spirit reserve.
I'm playing on ps5 and I can't seem to deactivate this minion skill that's reserving my spirit. I've tried removing the scepter etc. Is this permanent ?