Button pressing near NPC or portal

If you can please consider change how skill button A is working on xbox when on map is NPC or portal. When you enter map and there are some monster start using skill asign to A button teleport you back to town instead killing monsters. The same is with NPC, Zana, Tane, Cassia or other near monsters causing pop up conversation window not using skills asign to A. If I have to press it for lets say 3sec will be great.

I like the idea, but 3 seconds is *an eternity* in PoE.

0.5 seconds would be easily sufficient.

The difficulty becomes that the current "hold button" interface doesn't allow any other actions to take place.

So it's not a 1:1 "insert the Ultimatum function into X", because you still need the button to do what it's supposed to do when pressed briefly, and do something else when held.

Yeah, you point it right 3sec its way too long but it just idea. They need to figure out something. Unlucky pad doesnt have many button free to swap it for other one.
I get used to flasks buttons but here same button for skill and interaction is just more than annoying...