Spectres getting deleted

Ok so if you have a 25 lvl of spectres that gives you 3 spectres and you switch to the secondary set of weapons which don't give extra levels to spectres then the spectre level goes from 3 to 2 maximum spectres.
This DELETES the last spectre without any way of restoring it. It doesn't show in desecration pool nor it follows you as a ghost like it died.
It straight up deletes the spectre.

Please fix, thanks in advance.