Spectres disappearing in Expeditions

Sometimes during Expeditions, my spectres seem to completely disappear. They are still present in the tooltip, but do not do anything, no casts, no attacks, nothing.
Once I leave the map, they're back and active.
This happens pretty consistently.