interrater reliability help?

#1
Dear all,

I'm hoping for some direction in choosing between cohen's kappa and ICC for my interrater reliability. I have 2 coders rating the presence of expressions 1 or 0 (present or not). I'm leaning towards cohen's kappa, but I don't totally understand the relevant difference between the two statistics in this situation...

Maybe someone could clarify the distinction between CK and ICC for me?

Thanks!
 

CB

Super Moderator
#2
AFAIK Cohen's kappa is usually used for categorical or dichotomous items/measurements, whereas the ICC is used is used for quantitative/scalar measurements. So Cohen's kappa would make most sense to me here. I don't know a lot about this area though.