Spirit Gem Buffs no longer work for me.

The buffs from my spirit gems Herald of Thunder, and Lingering Illusion are no longer working for my Hollow Palm monk. The gems are showing that they are active when I go to turn them on/off, and are using my spirit, but when I leave that screen it shows my spirit is full and the buffs are not applying. I've tried a few of my other characters, and they are fine. The issue seems to be just on this monk. Anyone else having an issue like this?

I equipped a bow, shot with it a couple of times, and the buffs showed up again. I feel like this has something to do with Hollow Palm.