I cannot allocate half of my Ritual Atlas Tree

I got a point to spare and half of the tree allocated. I can only allocate one small node, the remaining Nodes i cannot path to / allocate.
Its like I wouldnt have pathed there yet.

https://imgur.com/a/LeIWbR7
Here i can only allocate the left small node.