Can't Get To Any More Lost Towers

I am able to see the lost towers through the fog of course, but whenever I am looking around my atlas to try and find another tower to clear that would get me further away from the ziggurat refuge, I cant seem to find one that it is possible for me to reach due to either fog of war or the nodes just not connecting. Any advice for this issue would be great!