This is utter nonsense.

When the ruling class are not elected but chosen based on family, wealth, and other such means, those outside of that class are considered to be of less worth.

The concept of fairness allows us to ask whether the difference is justified. In such a system you would not be able to disagree with it because in your words, you have failed, not the system.