inter-rater

  1. M

    How to calculate inter-observer/ inter-rater reliability of ordinal data in R?

    Hello, I have the question which measurement to use in order to calculate the inter-observer reliability in R once for an ordinal and once for a nominal data set. Part1) Ordinal data set 2 observers gave scores on a scale from 1.0 to 5.0 with steps of 0.25 Example of data: observ1...
  2. P

    Inter-rater Reliability With 3 Coders

    Hello, I have three coders who have rated 22 dichotomous (present/absent) variables for 15 open-ended responses. Is it appropriate to use Fleiss Kappa here? And if so, is there a unique syntax for such a case? Thanks to whomever can help, PG BAH, Psychology