If we can increase the payout of those things we see as valuable, why should we not have the same power to decrease the payouts?

I'll admit that I was once on the let's-compain-about-downvotes train. I was bitter,and made a few negative comments about the whale who down voted me. But with hindsight I can see that I was just acting emotionally, not rationally.

Though it doesn't always work to my benefit I think the system makes sense.