Interrater Reliability. Is MORE better?


Less is more. Stay pure. Stay poor.
More judges would help to minimize sampling issues in acquiring a representative sample of judges, i.e., if you had two judges and one was biased in some way they may weight the conclusion the wrong direction of the real truth.