A Large-Scale Multi-Document Summarization Dataset from the Wikipedia Current Events Portal
Multi-document summarization (MDS) aims to compress the content in large document collections into short summaries and has important applications in story clustering for newsfeeds, presentation of search results, and timeline generation. However, there is a lack of datasets that realistically address such use cases at a scale large enough for training supervised models for this task. This work presents a new dataset for MDS that is large both in the total number of document clusters and in the size of individual clusters. We build this dataset by leveraging the Wikipedia Current Events Portal (WCEP), which provides concise and neutral human-written summaries of news events, with links to external source articles. We also automatically extend these source articles by looking for related articles in the Common Crawl archive. We provide a quantitative analysis of the dataset and empirical results for several state-of-the-art MDS techniques.
Code (1)
Tasks
ArticlesClusteringDocument SummarizationMulti-Document SummarizationSimilar Papers 제목 키워드 기반
Multi-XScience: A Large-scale Dataset for Extreme Multi-document Summarization of Scientific Articles
Multi-document summarization is a challenging task for which there exists little large-scale datasets. We propose Multi-XScience, a large-scale multi-document summarization dataset created from scientific articles. Multi…
ArticlesDescriptiveDocument SummarizationExtreme Summarization+1Adapting Neural Single-Document Summarization Model for Abstractive Multi-Document Summarization: A Pilot Study
Till now, neural abstractive summarization methods have achieved great success for single document summarization (SDS). However, due to the lack of large scale multi-document summaries, such methods can be hardly applied…
Abstractive Text SummarizationDocument SummarizationMachine TranslationMulti-Document Summarization+1Multi-News: a Large-Scale Multi-Document Summarization Dataset and Abstractive Hierarchical Model
Automatic generation of summaries from multiple news articles is a valuable tool as the number of online publications grows rapidly. Single document summarization (SDS) systems have benefited from advances in neural enco…
ArticlesDecoderDocument SummarizationExtractive Summarization+1Towards a Neural Network Approach to Abstractive Multi-Document Summarization
Till now, neural abstractive summarization methods have achieved great success for single document summarization (SDS). However, due to the lack of large scale multi-document summaries, such methods can be hardly applied…
Abstractive Text SummarizationDocument SummarizationMulti-Document SummarizationLMGQS: A Large-scale Dataset for Query-focused Summarization
Query-focused summarization (QFS) aims to extract or generate a summary of an input document that directly answers or is relevant to a given query. The lack of large-scale datasets in the form of documents, queries, and …
DiversityLanguage ModelingLanguage ModellingQuery-focused Summarization+1