Every so often, I get terrible connection for about a minute or so like this

As the title says, every so often, my connection looks like this, quickly going from 30-40ms all the way up to 400-700ms or so(sometimes higher) and going up and down for the next minute or two. This doesn't happen all the time so it's a bit difficult to do a WinMTR check with it since it takes about as long for me to get the ip of the instance, put it in and set up the test as it takes for it to eventually go away. What should I do? (I've not really used imgur much, so if you can't see the image for some reason let me know how to set it so you can)

*Fixed image

My guess is that Your ISP is doing something in its structure.