This is what fixed my Latency spikes!

My Netgear Orbi home mesh system recently updated its firmware and it enabled the WMM (Wi-Fi multimedia) settings. WMM (Wi-Fi Multimedia) is an automated service that gives priority to multimedia running through your wireless network. Turn that off. Every router has some kind of load balancing or priority setting for multimedia. You might have to google what your routers version or name is called. I hope this helps!

I went from 38ms to 5kms every 10-12 seconds to a smooth 38ms-44ms like it was prior to the firmware update. Good luck!