[Possible] Memory leak issue or something with the game?

I've been busy crafting for a bit but noticed the game was choppy and pressed F1 it showed 45 FPS in my hideout. Closed the game and opened it again, no problems 60 FPS is back.

This seems to happen every few hours or so. Nothing else in resource manager is using anything besides PoE2