Is there any way to give priority to Pickup item or interact when using controller ?

Hi. I'am Controller player but for now I have a Quest for interact with Death Crystal

https://imgur.com/PXZX7Zu

But when using the Controller if there are enemy around there it will give priority to attack when push the button

There are anyway to config or setting about this.

Thanks