Very High RAM usage

Been getting extremely high RAM usage from the game that keeps going up even if I just stand in place. Occurs in multiple areas. It says it is only 3.5 GB used in game, but Windows Task Manager gets up to 9GB and got as High as 11 Before crashing.

I've tinkered with settings a lot, but nothing seems to help.

I have the same problem usage jumps from 3 to 11GB

Do you also frequently get unexpected disconnects and rollbacks ?

Definitely something wrong here, memory usage just gets insanely high and I keep on encountering hard freezes where the only way to continue is to alt+f4.