Extremely poor performance on poe2, looking for tips.

I have an intel i5 12600k, AMD RX 6700 XT and 32 gb RAM, 1080p, computer is less than 2 years old, and I am getting terrible performance on POE 2. Using the client, I average 80-90 fps in hideout but when entering a map I get around 50, and as soon as action happens on my screen, it averages around 25-35 fps, however some areas (such as the last few areas of act 3/6) I get as low as 5 fps. Killing the Viper boss was almost impossible because of my fps being so low.

I tested poe 2 on my laptop which has an i7 3700H and an nvidia RTX 4060, running at 2560 x 1600 and I get a stable 55-60 all the time.

I am playing on low settings, I have all my drivers updated, windows 11. Any tips appreciated.