Massive latency and disconnect when travelling to other hideouts

If I travel to someone's hideout for trade, the game gets massive latency and freezes, resulting in a disconnect after ¬20sec. I guess its server dependent, since rarely I can trade in someone's hideout with no issue.

It seems each hotfix, introduces more bugs. Not being able to trade now, has really made this game unplayable.