Map progression disappears

When going back to town and coming right back all map progress is gone. When dyeing and respawning at checkpoint all progress is gone on map. When going through a portal and coming back all previous progress is gone. Any help on this is appreciated