Tower map disappearing

On console. Put a map into a tower. Accidentally put a second map into the tower. Thought it would swap, but the second one disappeared.

Removed initial map. Nothing in the tower. Put map back in. Can't open the map.. remove the map again and it let me open the second map that had disappeared, but didn't show anything (a map being present or opened tablet slots, etc., looked to be empty.)

There was no way to remove the ghost map, and no way to swap it either.

Edit: forgot to add the second map had delirium and the first one didn't. Not sure if that'd make a difference.