ACL tutorial proposal: Towards Reproducible Machine Learning Research in Natural Language Processing

Open Access
Authors
  • K. Sinha
  • J. Dodge
  • S. Luccioni
  • R. Stojnic
Publication date 2022
Host editors
  • L. Benotti
  • N. Okazaki
  • Y. Scherrer
  • M. Zampieri
Book title The 60th Annual Meeting of the Association for Computational Linguistics
Book subtitle ACL 2022 : tutorial abstracts : May 22-27, 2022
ISBN (electronic)
  • 9781955917209
Event 60th Annual Meeting of the Association for Computational Linguistics
Pages (from-to) 7-11
Number of pages 5
Publisher Stroudsburg, PA: Association for Computational Linguistics
Organisations
  • Faculty of Science (FNWI) - Informatics Institute (IVI)
Abstract
While recent progress in the field of ML has been significant, the reproducibility of these cutting-edge results is often lacking, with many submissions lacking the necessary information in order to ensure subsequent reproducibility. Despite proposals such as the Reproducibility Checklist and reproducibility criteria at several major conferences, the reflex for carrying out research with reproducibility in mind is lacking in the broader ML community. We propose this tutorial as a gentle introduction to ensuring reproducible research in ML, with a specific emphasis on computational linguistics and NLP. We also provide a framework for using reproducibility as a teaching tool in university-level computer science programs.
Document type Conference contribution
Language English
Published at https://doi.org/10.18653/v1/2022.acl-tutorials.2
Downloads
2022.acl-tutorials.2 (Final published version)
Permalink to this page
Back