Action speed loss in maps (PoE2EA)

I've had this happen twice while mapping where I get hit with a slow but the debuff icon is gone but I notice that my character is slowed down by a big margin.

Everything from attacking to dodge rolling, my action speed is reduced. No debuff icons showing and with no mobs around. I can only assume some attack or spell a mob is doing is not getting removed after the initial debuff icon expires.

The only solution I found was to portal out.