Social Media Research

01 Theory


Question

Explain the concept of Inter-Rater Reliability!


Answer

Inter Rater Reliability (IRR) describes the extend to which multiple coders come to the same conclusion when coding data.

There a different Methods to measure IRR

  • Percentual Agreement: easy, widely used but apparently not sufficient/perfect
  • Other methods include: Holsti's method, Scott's pi, Kippendorfs alpha and Cohen's Kappa



Comments