Disconnect when teleporting to party member at azurite mine

I delve with a friend and whenever one of us goes there for the first time and the other teleports the second player gets disconnected and sent to login screen. After reconnecting the disconnect doesn't happen until the first player resets the delve instance and the second player tries to teleport again.

This happens using the whirlpool icon and using the portal created in the first player's hideout when he goes to the azurite mine.