Crashing when using portal to town

I am playing on Xbox series X. The game crashes to the dashboard extremely often when teleporting or even being in a town. I am in act 1 and crash almost every time I return to Clearfell. Sometimes the game crashes the instant it reloads because that is where my character is.

The game freezes fairly often too. This happens in combat usually, but have had it happen when I died as well needing a restart of the game.