Abstractive Document Summarization without Parallel Data
Abstractive summarization typically relies on large collections of paired articles and summaries. However, in many cases, parallel data is scarce and costly to obtain. We develop an abstractive summarization system that relies only on large collections of example summaries and non-matching articles. Our approach consists of an unsupervised sentence extractor that selects salient sentences to include in the final summary, as well as a sentence abstractor that is trained on pseudo-parallel and synthetic data, that paraphrases each of the extracted sentences. We perform an extensive evaluation of our method: on the CNN/DailyMail benchmark, on which we compare our approach to fully supervised baselines, as well as on the novel task of automatically generating a press release from a scientific journal article, which is well suited for our system. We show promising performance on both tasks, without relying on any article-summary pairs.
Code (1)
Tasks
Abstractive Text SummarizationArticlesDocument SummarizationSentenceSimilar Papers 제목 키워드 기반
Unsupervised Abstractive Summarization of Bengali Text Documents
Abstractive summarization systems generally rely on large collections of document-summary pairs. However, the performance of abstractive systems remains a challenge due to the unavailability of parallel data for low-reso…
Abstractive Text SummarizationExtractive SummarizationLanguage ModelingLanguage Modelling+2Adapting the Neural Encoder-Decoder Framework from Single to Multi-Document Summarization
Generating a text abstract from a set of documents remains a challenging task. The neural encoder-decoder framework has recently been exploited to summarize single documents, but its success can in part be attributed to …
DecoderDocument SummarizationMulti-Document SummarizationParallel Hierarchical Transformer with Attention Alignment for Abstractive Multi-Document Summarization
In comparison to single-document summarization, abstractive Multi-Document Summarization (MDS) brings challenges on the representation and coverage of its lengthy and linked sources. This study develops a Parallel Hierar…
Document SummarizationMulti-Document SummarizationAbstractive Multi-Document Summarization via Joint Learning with Single-Document Summarization
Single-document and multi-document summarizations are very closely related in both task definition and solution method. In this work, we propose to improve neural abstractive multi-document summarization by jointly learn…
DecoderDocument SummarizationMulti-Document SummarizationCATAMARAN: A Cross-lingual Long Text Abstractive Summarization Dataset
Cross-lingual summarization, which produces the summary in one language from a given source document in another language, could be extremely helpful for humans to obtain information across the world. However, it is still…
Abstractive Text SummarizationArticlesCross-Lingual Abstractive Summarization