I dont think its up to me to decide whether something is paying out too much or not. clearly its not setup for that and using the flag for that makes no sense as you describe. so i understand the concern, but i feel like you should give value not take it away. maybe the upvote just counts for too much. but adding a devaluation button seems counterproductive to me.
RE: How to fix the downvoting issue?