Overview of the CLEF 2022 SimpleText Task 1 Passage Selection for a Simplified Summary

Open Access
Authors
  • E. SanJuan
  • S. Huet
  • J. Kamps ORCID logo
  • L. Ermakova
Publication date 2022
Host editors
  • G. Faggioli
  • N. Ferro
  • A. Hanbury
  • M. Potthast
Book title Proceedings of the Working Notes of CLEF 2022 - Conference and Labs of the Evaluation Forum
Book subtitle Bologna, Italy, September 5th to 8th, 2022
Series CEUR Workshop Proceedings
Event 2022 Conference and Labs of the Evaluation Forum, CLEF 2022
Pages (from-to) 2762-2772
Number of pages 11
Publisher Aachen: CEUR-WS
Organisations
  • Interfacultary Research - Institute for Logic, Language and Computation (ILLC)
Abstract

This paper presents an overview of the CLEF 2022 SimpleText track’s Task 1, asking systems to retrieve scientific abstracts in response to a query prompted by a popular science article. We discuss the details of the task set-up: First, the SimpleText Corpus with over 4 million academic papers and abstracts. Second, the Topics based on 40 popular science articles in the news and the 114 Queries prompted by them. Third, the Formats of requests and results, the Evaluation labels and Evaluation measures used. Fourth, the Results of the runs submitted by our participants.

Document type Conference contribution
Language English
Published at http://ceur-ws.org/Vol-3180/paper-235.pdf
Other links http://ceur-ws.org/Vol-3180 https://www.scopus.com/pages/publications/85137002335
Downloads
paper-235 (Final published version)
Permalink to this page
Back