It doesn't have to make enemies if people don't take it so personally. I think it is good to establish audiences and for people to know the values you stand for by downvoting posts you find offensive / objectionable.

Being afraid to downvote is the same as being afraid to post for fear of making an enemy. Both are important for the platform to survive long term.