How/when are effects from weapon-set talents calculated?

Say I take a talent with +% fire damage for my 2nd weapon set. I cast a fire spell that takes a moment to erupt or that does fire damage over time. I switch to weapon set 1. Do I lose all the bonus or does the game 'remember' which effects were active when you cast/attack, no matter how long it takes before the damage is delivered?