Can't Assign Atlas Tree Points

I allocated up to 22 nodes on one character, got to t10 maps, then I leveled up another character. Now I cleared some t6 maps with the new character outside the fortress, tells me I have 3 unallocated points that I cant assign. I tried clearing a t10 map with the new character inside the fortress and got a skill point i can assign, but still cant assign the other 3.

Maybe it's a display bug?

I had a similar issue before realizing that they were atlas point for specific trees and not the main tree. Anything outside of the fortress gives points for specific trees(Breach/Abyss/Etc). It would be nice if the indicator was different since there's like 7 trees now.