Golden Charm Primate vs Atziri Temple

When I'm using the primate charm, I gets stuck between two rooms, even after killing all the mobs in the room.

Can you check if it's some interaction between the primates entering and exiting the rooms that causes them to lock and not open to go to the next room?