MoonDancers as spectre causing major performance issues

Hello, As stated by many ingame, moondancers raised as spectre have been a blast to play with but a burden on my pc (my pc is fairly new with a 4070TI) A lot of people disconnect when they teleport to my hideout and a lot of them have been advising me to stop using these mobs as spectres. Can you please address this?