Weapon swapping and banner interaction (Or lack thereof)

Currently it seems that you are unable to activate the banner if you assign banners to one weapon set and are currently using the other weapon set.

For example, weapon set 1 has banners assigned, I am currently using weapon set 2. The banner skills are disabled, and I am unable to activate them. I need to use another skill to go back to weapon set 1 before I am able to use the banners.

I believe that those skills should be causing the swap back to weapon set 1, then the banner skill gets used.

To add to this, passive glory generation also does not work while using the unassigned weapon set