The algorithm versus the chimps: On the minima of classifier performance metrics
| Authors |
|
|---|---|
| Publication date | 2020 |
| Host editors |
|
| Book title | BNAIC/BeNeLearn 2020 |
| Book subtitle | proceedings : Leiden, the Netherlands, November 19-20, 2020 |
| Event | BNAIC/BeneLearn 2020 |
| Pages (from-to) | 38-55 |
| Publisher | Leiden: Universiteit Leiden |
| Organisations |
|
| Abstract |
n this paper we seek the minima of performance metrics for binary classification to facilitate comparison between metrics and applications, and to assess the quality of inferential statistics made from non-probability samples. We use these minima to min-max normalize the performance metrics so that they can be interpreted as a percentage of the perfect classifier relative to the proverbial chimps at the zoo†guessing at random. We compare our results with the balanced metrics that have been introduced recently, which are corrected for bias due to class imbalance.
|
| Document type | Conference contribution |
| Language | English |
| Published at | https://bnaic.liacs.leidenuniv.nl/wordpress/wp-content/uploads/bnaic2020proceedings.pdf |
| Downloads |
The algorithm versus the chimps
(Final published version)
|
| Permalink to this page | |
