Overview of the CLEF 2024 SimpleText Task 1: Retrieve Passages to Include in a Simplified Summary
| Authors |
|
|---|---|
| Publication date | 2024 |
| Host editors |
|
| Book title | Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2024) |
| Book subtitle | Grenoble, France, 9-12 September, 2024 |
| Series | CEUR Workshop Proceedings |
| Event | 2024 Conference and Labs of the Evaluation Forum |
| Article number | 305 |
| Pages (from-to) | 3115-3128 |
| Number of pages | 14 |
| Publisher | Aachen: CEUR-WS |
| Organisations |
|
| Abstract |
This paper presents an overview of the CLEF 2024 SimpleText Task 1 on Content Selection, asking systems to retrieve scientific abstracts in response to a query prompted by a popular science article. Overall, the SimpleText track provides an evaluation platform for the automatic simplification of scientific texts. We discuss the details of the task set-up. First, the SimpleText Corpus with over 4 million academic papers and abstracts. Second, the Topics based on 40 popular science articles in the news and the 114 Queries prompted by them. Third, the Formats of requests and results, the Evaluation labels and Evaluation measures used. Fourth, the Results of the runs submitted by our participants.
|
| Document type | Conference contribution |
| Language | English |
| Published at | https://ceur-ws.org/Vol-3740/paper-305.pdf |
| Other links | https://ceur-ws.org/Vol-3740/ |
| Downloads |
paper-305
(Final published version)
|
| Permalink to this page | |
