I think that's brought up in the Bible (some one asks Jesus if a widow remarries who is she married to in the afterlife, first husband or second). Once you're dead, your marriage is absolved and your afterlife is strictly about God and not the love of other humans. It's why widow/ers can remarry and it's not seen as adultery or anything like that.