Wand Barrage + sacred wisps

Im currently leveling a barrage deadeye wander and i forgot to add sacred wisps since its a wand attack. After adding it and attacking the wisps spawn so fast that they dont attack, so its not working at all with barrage. there just huge white orbs all the time from the summoning of them all of the time but as soon as they spawn theres already another one and theres no window for them to attack.