By the looks of it you did not get downvoted. So it could have been 3 things. People removing their votes, the voting power of people who voted on you dropping, or the steem price dropping.