tl;dr - scroll down
I think the real issue here is what I call moral symmetry.
The idea of privilege requires a criterion for determining who are the privileged and who are the de-privileged. The criterion might be “has the name King Edward” and that’s all there is to it… i.e. because he’s King Edward, therefore, he is privileged and all others are de-privileged. Or, it might be “is employed by the US Government”. Or whatever.
The key is that once we establish the privilege criterion, then we can engage in social criticism of the privilege criterion. Why this criterion rather than that criterion? An alien observing from space would be puzzled why any particular criterion should be preferred apart from some structural characteristic in the privileged individual(s). For example, when we observe an ant or bee colony, we can see in the anatomy of the “queen” why she is treated differently than the others and we can also see how this factors into the reproductive logic of the species. In wolf packs, we can see the genetic and social dynamics (alpha male mating, male-to-male competition/dominance, etc.) that determine why this wolf rather than that wolf should be “in charge”, so to speak.
The characteristics that aliens observing us would identify, of course, would be vastly more complex than the dynamics that we observe in other animals. But the key is that even if we could get the study notes of such an alien and read them and understand why it is that some of us are privileged while others are not, this would still not serve as a justification for privilege. In other words, it would still be special-pleading and a circular argument for the privileged to invoke the natural causes of their privileges in the course of settling a dispute.
Hence, the causes of moral asymmetry are irrelevant to dispute-resolution. For this reason, moral symmetry (rights appear the same from each individual’s point-of-view, aka the Golden Rule, Categorical Imperative, etc. etc.) is the only possible basis on which to conduct dispute-resolution. Note that the existence of privilege is not incompatible with dispute-resolution… it is only the invocation of privilege in the course of settling the dispute that is incongruent. Alice may be able to have Bob beaten up if he tries to claim damages against her for having publicly insulted him. But she may not invoke this fact in the course of settling the dispute with Bob.
Using force to defend oneself is not morally asymmetrical… that is, everyone has the same natural ability to defend themselves (fists, claws, etc.). Hence, pacifism is not more symmetrical (i.e. more congruent with a fair dispute-resolution) than NAP. Stated differently, no one may claim during the course of a dispute that a failure to respond pacifistically is inconsistent with dispute-resolution, that is, a procedural violation of the legal process. For example, let’s say Alice takes a swing at Bob and Bob pushes Alice away from himself. Now, Alice sues Bob. When Bob tries to claim self-defense, Alice states: “Bob has not kept the peace. In reacting to my swinging fist and pushing me away, he used violence and this is a contradiction of peace. Hence, Bob’s claim of self-defense is invalid because it is made on the basis that violence is justifiable, which is a contradiction of the whole premise of dispute-resolution.”
Here, we have the opposite extreme of claiming privilege. The disputant who claims privilege engages in the logical contradiction of saying, “Settle this dispute with me nonviolently on terms X or else there will be violence.” The insertion of “nonviolently” into the last sentence is gratuitous… it may as well not be there and is merely a pretense.
The person who claims pacifism claims a non-existent moral high-ground. “Settle this dispute with me and admit you were wrong to use violence in defense of your property and pay me these damages.” Or else what? You will become violent? You cannot deny another person’s right to self-defense in the course of settling a dispute without contradicting the very purpose of dispute-resolution which is to settle a dispute non-violently instead of violently.
tl;dr - It is a mistake to think of NAP as being “enforced” by anyone - rather, it is “enforced” by each individual in respect to his own affairs. If you break into Bob’s house, Bob might shoot you. But Jerry can’t shoot you for breaking into Bob’s house. So, collectivizing NAP does lead to the contradiction you mention. Also, pacifistic interpretation of NAP (no one may use force under any circumstances… not even defense) is contradictory if it is intended to be enforced in any way besides shunning.
Clayton -