Network doing overtime

My network goes bonkers in town, spiking to 200-300 ms every few seconds. Sometimes it affects my drive and shader aswell, but not as often.

It also happens on a couple of maps. Some maps works without a problem, others spikes aswell.

Any help would be appreciated