Elemental Invocation does not work with multiple copies

I'm trying to use 3 Elemental Invocations. When I enable all of them, I correctly get 3 separate action buttons to use each of them, but I only get one Elemental Invocation buff, so it's basically only charging one of them. This is not what I expected since other triggers like Cast on Freeze do work with multiple copies equipped at once.