Contract: Slaver's Revenge cannot be completed

I escaped with Hapihapi's Charm and my quest state will not update. I tried dropping it and picking it back up, and still no progress. I got the unique contract from the quest contract, and even did that and got Whakano's reward for killing the slaver king, but he will not take Hapihapi's charm out of my inventory.