On the usefulness of interrater reliability coefficients

Open Access
Authors
Publication date 2018
Host editors
  • M. Wiberg
  • S. Culpepper
  • R. Janssen
  • J. González
  • D. Molenaar
Book title Quantitative Psychology
Book subtitle The 82nd Annual Meeting of the Psychometric Society, Zurich, Switzerland, 2017
ISBN
  • 9783319772486
ISBN (electronic)
  • 9783319772493
Series Springer Proceedings in Mathematics & Statistics
Event 82nd Annual Meeting of the Psychometric Society
Pages (from-to) 67-75
Publisher Cham: Springer
Organisations
  • Faculty of Social and Behavioural Sciences (FMG) - Research Institute of Child Development and Education (RICDE)
Abstract For four data sets of different measurement levels, we computed 20 coefficients that estimate interrater reliability. The results show that the coefficients provide very different numerical values when applied to the same data. We discuss possible explanations for the differences among coefficients and suggest further research that is needed to clarify which coefficient a researcher should use to estimate interrater reliability.
Document type Conference contribution
Language English
Published at https://doi.org/10.1007/978-3-319-77249-3_6
Downloads
Permalink to this page
Back