Locked mansion in the mists

While doing the wisp maps to unlock the Mansion in the Mists, the wisps moved to the mansion itself, making it not able to be unlocked.

Ref: 879 289 385

EDIT: completing some maps nearby (without wisps) unlocked the map. Maybe not a bug, just path required one specific map.