Overview of MSLR2022: A Shared Task on Multi-document Summarization for Literature Reviews
We provide an overview of the MSLR2022 shared task on multi-document summarization for literature reviews. The shared task was hosted at the Third Scholarly Document Processing (SDP) Workshop at COLING 2022. For this task, we provided data consisting of gold summaries extracted from review papers along with the groups of input abstracts that were synthesized into these summaries, split into two subtasks. In total, six teams participated, making 10 public submissions, 6 to the Cochrane subtask and 4 to the MSˆ2 subtask. The top scoring systems reported over 2 points ROUGE-L improvement on the Cochrane subtask, though performance improvements are not consistently reported across all automated evaluation metrics; qualitative examination of the results also suggests the inadequacy of current evaluation metrics for capturing factuality and consistency on this task. Significant work is needed to improve system performance, and more importantly, to develop better methods for automatically evaluating performance on this task.
Code (1)
Tasks
Document SummarizationMulti-Document SummarizationSimilar Papers 제목 키워드 기반
Overview of the Third Workshop on Scholarly Document Processing
With the ever-increasing pace of research and high volume of scholarly communication, scholars face a daunting task. Not only must they keep up with the growing literature in their own and related fields, scholars increa…
Document SummarizationGraph GenerationInformation RetrievalMulti-Document Summarization+2LED down the rabbit hole: exploring the potential of global attention for biomedical multi-document summarisation
In this paper we report on our submission to the Multidocument Summarisation for Literature Review (MSLR) shared task. Specifically, we adapt PRIMERA (Xiao et al., 2022) to the biomedical domain by placing global attenti…
An Extractive-Abstractive Approach for Multi-document Summarization of Scientific Articles for Literature Review
Research in the biomedical domain is con- stantly challenged by its large amount of ever- evolving textual information. Biomedical re- searchers are usually required to conduct a lit- erature review before any medical in…
ArticlesDocument SummarizationMulti-Document SummarizationExploring the limits of a base BART for multi-document summarization in the medical domain
This paper is a description of our participation in the Multi-document Summarization for Literature Review (MSLR) Shared Task, in which we explore summarization models to create an automatic review of scientific results.…
Document SummarizationMulti-Document SummarizationEvaluating Pre-Trained Language Models on Multi-Document Summarization for Literature Reviews
Systematic literature reviews in the biomedical space are often expensive to conduct. Automation through machine learning and large language models could improve the accuracy and research outcomes from such reviews. In t…
Document SummarizationMulti-Document Summarization