Idea on how to fix spectres/minion system in general

So I just had a thought here. What if there was a keystone that allowed you to allocate however many passive points you put into it into a custom kinda character stat screen for specters. Like say 1 point was a 5% or 10% move speed boost and 10 would be 50 or 100% etc. You could make it kinda counter balance other stats to like hearts of iron 4 where if you allocate more into armor on a ship it makes it slower etc. I also think it would be far easier to balance and give a ton of diversity to the class since you would be able to pick any specter and make it good with enough stats while fixing almost all of what a specific one lacks by allocating more points into it. The only real thing you would need to balance is the few outliers that get boosted to hard from going all in on one stat.

You could make it unique to minions or just leave all the minion stuff up for the basic minions and have this be the specter system.