Lost spirit and can't use support gems after changing ascendancy

I recently switched my druid from an Oracle to a Shaman and after doing so my spirit dropped to 50 and when I try to activate support gems it says I don't have enough spirit even though I'm not using anything that requires spirit. The new build I was switching to required a scepter in my 2nd weapon slot with and I feel like this was part of the issue. I've stopped using the scepter and not following that build anymore but my spirit is still half what it was and my support gems won't activate. Anyone else had this issue and find a fix for it?

I don't have that talent anymore but I still only have 50 spirit and can't activate my support gems cause it says I'm using all 50 when I'm not currently using any. I truly appreciate the input though as I'm trying to get this figured out. Thank you.

Well, I stand corrected. I did still have it. Thank you again for the post cause it made me double check. I could've swore I took it off. what can I say, I'm an idiot lol. Thank you!