Network Spikes

I have insane network spikes on every server, only in PoE. i log in sometimes i can play a few minutes or even hours and then it spikes from my normal 12ms to up to 100k+ and goes down, goes back up and so on till i get logged out or have to end the game and play something else. Sometimes it hapens in random maps, sometimes in the hideout, sometimes in any act, so everywhere basically. Everything else runs fine, i tried reinstalling windows since some had this issue after the last windows update, i reinstalled the game, i reset my router, nothing helped.

And it seems like it's not just me, but i can't fix a server problem, so no damn clue what i should do now.

Specs: CPU 5900x - GPU 3080 Strix - Ram 32GB
tried every setting, but it's not a graphic issue, so should not be relevant.
I could make a video, but you would only see my Network going up and down while GPU(8MS) / CPU(6MS) / Vram(4gb~ depens on the spot) / memory / driver stays the same.

E: This should be in Poe2... idk why it landed here, never used the forum before Sorry.