Calculating Weighted Kappa with SPSS

[Cassie]

Hello,

I need to calculate Weighted Kappa to determine inter-rater agreement for sets of scores obtained from 2 independent raters. As far as I can tell, I can only calculate standard Kappa with SPSS, and not Weighted Kappa.

Can anyone tell me if this is the case, and if so, can anyone suggest an alternative way of calculating inter-rater agreement using SPSS?

Thanks

[hunter1p]

Hello,

I need to calculate Weighted Kappa to determine inter-rater agreement for sets of scores obtained from 2 independent raters. As far as I can tell, I can only calculate standard Kappa with SPSS, and not Weighted Kappa.

Can anyone tell me if this is the case, and if so, can anyone suggest an alternative way of calculating inter-rater agreement using SPSS?

Thanks

I need to know how to calculate weighted kappa, too, so if I find out I will write back. In the meantime, here is a link that provides some detailed discussion on the topic of rater agreement. It might be of use to you, if you haven't discovered it already:
http://ourworld.compuserve.com/homep...rsax/agree.htm

[hunter1p]

I need to know how to calculate weighted kappa, too, so if I find out I will write back. In the meantime, here is a link that provides some detailed discussion on the topic of rater agreement. It might be of use to you, if you haven't discovered it already:
http://ourworld.compuserve.com/homep...rsax/agree.htm

See also
http://www.medcalc.be/manual/kappa.php
for the formulas MedCalc software uses for weights.

And see http://www.ptjournal.org/cgi/reprint/85/3/257 for a journal article that discusses kappa pros and cons, as well as adjustments that can be made to correct for the "cons".