Allocating weapon set passive points bug

I wanted to respec my passive tree for 2 weapons on my mercenary. I refunded points from the main tree and started to allocate the points for the different weapons sets. It stopped letting me spend points on the weapon set trees and would only allow me to spend points on the main tree even though I had 20+ points free to allocate.

Because of this I had gear and skills that the requirements were no longer met and I spent over 200k gold to just barley get it back to how it was before I tried to respec it.

I also am having this issue on my ranger. When I got my first two weapon set points, it let me allocate one, but not the second. Now I am up to 4, but it won't let me allocate any of them.