Latency issue

In towns, the latency is less than 5. However when i step into my hideout or maps to farm at, the latency just goes up to 200+? Played other games and everything seems fine.

Nothing like this happened before a week ago. Anyone experiencing this or has a solution?