Harvest Scarab of Wisps

I don't seem to be benefiting from it at all. Really feels like tribute whether I am in the area and I see the buff active on me or not. If it's doubling, I should have noticed. I suspect this might be due to playing a totem build and the buff might require that I kill things. Made sure totems are also in the area, still no real change in tribute earnings. Unfair to totem builds if this is intentional.