Needing to switch back and forth between DX12 and Vulkan to keep performance high

Heyhey,

I've set the game locked to 60fps and everything is super smooth in general. After a while though, things can start to look a bit choppy and when I look at the performance metrics, for some reason I'm looking at ~45fps and eventually it'll drop to slightly below 30fps and stays there. No idea why. First time I noticed this, I fiddled around with some settings to see how I could get back to 60fps again, eventually found out that going from DX12 to Vulkan and back to DX12 got it back to the smooth 60fps again.

Now every time I notice I have to repeat this process, but is there a reason for this happening and is there a solution where I don't have to manually swap between DX12 and Vulkan every once in a while to keep performance up?