The random effects prep continues to mispredict the probability of replication

Authors
Publication date 2010
Journal Psychonomic Bulletin & Review
Volume | Issue number 17 | 2
Pages (from-to) 270-272
Organisations
  • Faculty of Social and Behavioural Sciences (FMG) - Psychology Research Institute (PsyRes)
Abstract
In their reply, Lecoutre and Killeen (2010) argue for a random effects version of prep, in which the observed effect from one experiment is used to predict the probability that an effect from a different but related experiment will have the same sign. They present a figure giving the impression that this version of prep accurately predicts the probability of replication. We show that their results are incorrect and conceptually limited, even when corrected. We then present a meaningful evaluation of the random effects prep as a predictor and find that, as with the fixed effects prep, it performs very poorly.
Document type Article
Language English
Published at https://doi.org/10.3758/PBR.17.2.270
Permalink to this page
Back