Invisible permanent Slow debuff

So usually I got this debuff once or twice during campaign run. Simple portal back to town and go back. BUT when it happen during The PRISONER BOSS fight, it is done for me. When I notice that I got the debuff (because It doesn't show on the UI, it's "invisible"), it was already too late. RIP my character