minion amount is not configurable for different loadout.

i can't set individual amounts of minions for the 2 weapon sets.
I was able to allocate different amounts when playing with controller but after some time the changes were gone (probably because i changed gear) and without controller it does not allow me to have different ammounts of minions.
i tried closing the skill gem menu, changing weapon set and open gem menu again.
as well as pressing the change hotkey in the menu.
both did not let me set individual minion ammounts.