Button pressing near NPC or portal

Hi, I got problem with skill use asign to button A on xbox. Using skill when there is NPC or portal does that I start conversation with NPC or I go back to hideout instead of slaying monsters. Its really frustrating and cause many deaths or teleport me back to town. Can you change way it works like in Ultimatum you need hold button longer to start interaction?

Would love to have a way to hide all NPC interactions similar to how “hide loot” works currently. There are so many instances where the hit boxes overlap something needs to be done.

Its should be like Ultimatum, just hold A button for 3sec etc and conversation windows pop up. After enter portal, blight or other encounter with NPC its just annoying especially button pressing in Poe is more than heavy🤟