Demon weapons swap bug

The infernalist demon form has a bug with weapon swapping where the spell doesn't cast on the first button press.

To reproduce,

- Be in demon form with one spell only on weapon set I and another spell only on weapon set II.
- Cast the first spell.
- Cast the second spell: the spell wont cast
- Cast the second spell again: the spell will cast.
- Cast the first spell: it won't cast
- Cast the first spell again: it will cast.

This doesn't happen when I'm in human form.

My specifics, I am playing with controller. I only have Despair on weapon set II, all my other skills are on weapon set I. I have different passives assigned for the two weapon sets.