Absolutely. It's the initiation of violence in the absence of it which is impermissible/unacceptable. It all boils down to consent. And when you violate the consent of another, you essentially negate the application of the principle to yourself. In other words, you forfeit consent when you violate another's. In this way, violence in self-defense (or defense of others) is acceptable.