It's an appealing idea, this way people can choose to focus on positivy(upvoting) or policing(flagging). It might be able to work with some great synergy.

But. What will happen when certain powerful groups use this to silence others? Might result in very terrible censure.

What do you think about the downsides?