it wouldn't at all. It's a big ocean and there are more than you can imagine. I'm consiedering buying steempower and bot, than run it for myself and for the good creators. When u have a good power, people hang around you more too :)
By the way i'm not sure but i heard if you don't have a good amount of sp, your flags wouldn't effect them much, but if they have a big power and flagging one of your content by them only once just kills you :)