Shader constantly spiking

Radeon 7800x
Ryzen 9600x
32GB ram
NVME SSD

Shader and drive constantly spiking as I move around maps, as if nothing is getting cached, sometimes game pauses long enough for me to die. This has started with the latest patch I believe.

Resetting shader cache or waiting for shader to catch up in the beginning of a map doesn't help. It keeps spiking even when returning to explored parts of the map.