Could it be that loss of empathy is connected to forgetting about death? Rich (meaning also healthy, beautiful, etc.) people tend to think they deserve their riches and that in a way poor (meaning also sick, ugly, etc.) people also deserve their misery - it's God's will, no? If you are a godly man he will surely reward you and punish you if you are not, no?
Or maybe it's karma. Rich people tend to think that in the previous life they somehow deserved their riches in this one, and poor people are of course being punished for being bad in their previous incarnation. Interestingly noone thinks about what will happen in the next life based on how you lead this one.
This kind of "I deserve this" thinking coupled with not thinking about dying is to be found everywhere today, don't you think?
By all means, enjoy your riches. Just... try not to be an asshole! ;)