PoE 2 Cpu problems

So i've been playing poe now for about 37 hours give or take, and it worked fine for the first 35 but now everytime i start the game i get massive frame drops that renders the game almost unplayable.

It start of with about 150 fps in the main menu and continues until i've loaded into the world and then the fps tanks down to about 40 - 50 frames and stays there most of the time, there can be some moments when im still walking around in the same area where i got 30 frames and from nowhere i get 70 - 80.
What i find most annoying is that there should be a problem with the specs i use either the cpu is a Amd ryzen 7 7800x3d with a radeon rx 7800 xt with corsair 64 gm ddr5 5200Mhz.

I just want to figure out why the game i want to play the most is borderline unplayable.