Random lag when changing zones

Any time I change zones it's entirely a flip of a coin if my ping will just start spiking randomly, or I'll just get disconnected entirely. It's not my internet because it only happens in poe and I've run latency tests as well as packet loss tests both of which are normal. I'm on NA servers, typically either Texas or Washington.