Skeletal Shrine not interacting with changes to minions

I'm running Golden Charlatan and the lag is insane after ramp, so i decided to try making the skeletons from Skeletal Shrine gone by using 6x To Dust Jewels with 20% reduced skeleton duration... the skeletons are still spawning and following me. Also tried using The Primordial Chain Amulet for the line "You cannot have non-golem minions" but the skeletons are still spawning. Modifiers to minions doesn't seem to be applying correctly to minions from this shrine.

However i'd much more recommend a revamp of shrines entirely instead of fixing this. feels really bad to have most of the shrines just be useless fodder to dilute the pool. i'd say the good shrines could be nerfed and all useless shrines reworked so everything is beneficial, just like how poe2 handled shrines.

It is intentional that your modifiers do not apply to minnions summoned by the Shrine.

You are not considered to be summoning them.