I have been thinking about this situation as many others have experienced it too. Creating your own community I think is the answer. When you create a Hive Community, you can decide who can post to it. Also, if you mute someone in your community, their comments are by default collapsed. I just tested this out, and the posts from muted accounts don't show up in the Community. As far as downvotes, I am not sure how this works, but since you already have an existing fan base, I highly recommend that you create your own Hive community, with you as the owner. In this way you will have more control over who you want to join it. Communities exist to solve these sorts of problems, and as we know, not everyone is going to get along, anywhere. People can definitely have more control over your experience this way.