Ice Nova + Astral Project not working properly when holding down cast

PC, Controller

When I hold down the cast button for ice nova, the first cast seems to work and cast on the monster, but for awhile each cast after that is around myself. If I don't hold down the button and keep clicking/pushing the button, it seems to work fine.