Spirit & minion issue

I noticed that every time I enter a new instance, my minions summoned has the "not enough spirit" exclamation mark warning, and I see it reflected in my projectile speed value on spark (I'm running abyssal lich w/ skeletal snipers). This is fixed by a weapon swap, taking out the reserved gem and putting it back in, or by unequiping+equiping my amulet which has spirit.

I have no spirit on weapons and differences between weapon sets either. My tree is constant between weapon sets. If it is applicable, I have 1 spirit grand spectrum and an against the darkness with spirit.

I have tried unspeccing nodes, lowering & re-raising minions allocated, changing gear with no spirit specced, etc. Have not been able to fix it.

This is relatively minor as I just have to weapon swap at the start of every map, but it would be nice to not have to deal with this.