Constant laggs in random zones

I have been getting laggs in random zones, like I join my HO after a map and the ping is jumping between 30-2000.
In my testing the lagg does not care about what the zone is (town, HO, map, any zone). It can also not happen for hours and than it comes back everyother zone. I can not reproduce it, it only happens by chance.
I can reset the lagg if I reload the zone were it can be done (Ctrl+Click). It also happens what ever realm I use, It happens in the US realms also just with worse lagg (I play in the EU).

Winmtr log in a laggy zone: https://pastebin.com/3PVEwDWX

Normal ping:



Laggy zone: