Emergency reload skill doesn't work with weapon sets

I have two crossbows setup. In Emergency reload skill settings I assign it to the crossbow 2 only, expecting that when I'll use it with crossbow 1 character WILL SWAP to the crossbow 2 and then buff it with Emergency reload. But in practice nothings happens at all, except my mana reduced and the skill goes on cooldown. No weapon swap, no reload animation, no nothing. Seems working fine when used with crossbow 2 already in hands though. There is also no way to tell if the buff applied or not, because there is no any visual changes anywhere, skills damage nubmers included.