The algorithm versus the chimps: On the minima of classifier performance metrics

Open Access
Authors
Publication date 2020
Host editors
  • L. Cao
  • W. Kosters
  • L. Lijffijt
Book title BNAIC/BeNeLearn 2020
Book subtitle proceedings : Leiden, the Netherlands, November 19-20, 2020
Event BNAIC/BeneLearn 2020
Pages (from-to) 38-55
Publisher Leiden: Universiteit Leiden
Organisations
  • Faculty of Economics and Business (FEB) - Amsterdam School of Economics Research Institute (ASE-RI)
  • Faculty of Economics and Business (FEB)
Abstract
n this paper we seek the minima of performance metrics for binary classification to facilitate comparison between metrics and applications, and to assess the quality of inferential statistics made from non-probability samples. We use these minima to min-max normalize the performance metrics so that they can be interpreted as a percentage of the perfect classifier relative to the proverbial chimps at the zoo†guessing at random. We compare our results with the balanced metrics that have been introduced recently, which are corrected for bias due to class imbalance.
Document type Conference contribution
Language English
Published at https://bnaic.liacs.leidenuniv.nl/wordpress/wp-content/uploads/bnaic2020proceedings.pdf
Downloads
The algorithm versus the chimps (Final published version)
Permalink to this page
Back