Cannot Remove Gems from Equipped Shield or Body Armor on Controller in Inventory Screen

Steps to Reproduce:
Socket Gems into Body Armor or Shield.
Move controller focus (simulated mouse pointer) to Body Armor.
Press B key to highlight socketed gem on Body Armor.

Expected Behavior:
Socketed gem becomes highlighted and moving the analogue stick moves the gem to inventory or other slots.

Actual Behavior:
Nothing happens. Socketed gems never get highlighted.

Workaround currently:
Unequip Body Armor. Press B key while Body Armor is highlighted unequipped and gem becomes focused like expected functionality.

This is currently happening with Body Armor and Off hand shield, the rest of the equipment appears to work fine.

Same issue but helmet for me.