Thread: Calculating Weighted Kappa with SPSS

1. Calculating Weighted Kappa with SPSS

Hello,

I need to calculate Weighted Kappa to determine inter-rater agreement for sets of scores obtained from 2 independent raters. As far as I can tell, I can only calculate standard Kappa with SPSS, and not Weighted Kappa.

Can anyone tell me if this is the case, and if so, can anyone suggest an alternative way of calculating inter-rater agreement using SPSS?

Thanks

2. Alternatives for inter-rater agreement

Originally Posted by Cassie
Hello,

I need to calculate Weighted Kappa to determine inter-rater agreement for sets of scores obtained from 2 independent raters. As far as I can tell, I can only calculate standard Kappa with SPSS, and not Weighted Kappa.

Can anyone tell me if this is the case, and if so, can anyone suggest an alternative way of calculating inter-rater agreement using SPSS?

Thanks

I need to know how to calculate weighted kappa, too, so if I find out I will write back. In the meantime, here is a link that provides some detailed discussion on the topic of rater agreement. It might be of use to you, if you haven't discovered it already:
http://ourworld.compuserve.com/homep...rsax/agree.htm

3. Kappa references

Originally Posted by hunter1p
I need to know how to calculate weighted kappa, too, so if I find out I will write back. In the meantime, here is a link that provides some detailed discussion on the topic of rater agreement. It might be of use to you, if you haven't discovered it already:
http://ourworld.compuserve.com/homep...rsax/agree.htm
See also
http://www.medcalc.be/manual/kappa.php
for the formulas MedCalc software uses for weights.

And see http://www.ptjournal.org/cgi/reprint/85/3/257 for a journal article that discusses kappa pros and cons, as well as adjustments that can be made to correct for the "cons".

Posting Permissions

• You may not post new threads
• You may not post replies
• You may not post attachments
• You may not edit your posts