What's the incentive in down votes

You're just hurting the blogger and you get no reward.