Switched to Abyssal Lich and now my mandible ant AI is broken

half my ants don't attack and just sit there. I've tried new gems, removing all points from the ascendency tree... best I can come up with, is slowly adding one at a time, and they'll be good until I teleport.

Basically unplayable now tho.