Hi there,

I want to conduct a study in which 15 raters will rate 100 photo's of cutaneous nevi. These 15 raters are divided into three groups of five people based on their level of training and expertise. To evaluate the level of agreement between the raters within each group, I will use the kappa statistics as described by Fleiss. Now comes the hard part for me. How do I compare the level of agreement between the three groups? I'm having a hard time finding out which statistical test I should use. Would I simply have to compare the confidence intervals of these groups?

Any help is appreciated!

kind regards,

Muller

I want to conduct a study in which 15 raters will rate 100 photo's of cutaneous nevi. These 15 raters are divided into three groups of five people based on their level of training and expertise. To evaluate the level of agreement between the raters within each group, I will use the kappa statistics as described by Fleiss. Now comes the hard part for me. How do I compare the level of agreement between the three groups? I'm having a hard time finding out which statistical test I should use. Would I simply have to compare the confidence intervals of these groups?

Any help is appreciated!

kind regards,

Muller

Last edited: