How to Write Summaries with Patterns? Learning towards Abstractive Summarization through Prototype Editing
Under special circumstances, summaries should conform to a particular style with patterns, such as court judgments and abstracts in academic papers. To this end, the prototype document-summary pairs can be utilized to generate better summaries. There are two main challenges in this task: (1) the model needs to incorporate learned patterns from the prototype, but (2) should avoid copying contents other than the patternized words---such as irrelevant facts---into the generated summaries. To tackle these challenges, we design a model named Prototype Editing based Summary Generator (PESG). PESG first learns summary patterns and prototype facts by analyzing the correlation between a prototype document and its summary. Prototype facts are then utilized to help extract facts from the input document. Next, an editing generator generates new summary based on the summary pattern or extracted facts. Finally, to address the second challenge, a fact checker is used to estimate mutual information between the input document and generated summary, providing an additional signal for the generator. Extensive experiments conducted on a large-scale real-world text summarization dataset show that PESG achieves the state-of-the-art performance in terms of both automatic metrics and human evaluations.
Code (1)
Tasks
Abstractive Text SummarizationText SummarizationSimilar Papers 제목 키워드 기반
Enhancing Abstractiveness of Summarization Models through Calibrated Distillation
Sequence-level knowledge distillation reduces the size of Seq2Seq models for more efficient abstractive summarization. However, it often leads to a loss of abstractiveness in summarization. In this paper, we propose a no…
Abstractive Text SummarizationInformativenessKnowledge DistillationTowards Abstractive Grounded Summarization of Podcast Transcripts
Podcasts have recently shown a rapid rise in popularity. Summarization of podcast transcripts is of practical benefit to both content providers and consumers. It helps consumers to quickly decide whether they will listen…
Abstractive Text SummarizationGUIR @ MuP 2022: Towards Generating Topic-aware Multi-perspective Summaries for Scientific Documents
This paper presents our approach for the MuP 2022 shared task —-Multi-Perspective Scientific Document Summarization, where the objective is to enable summarization models to explore methods for generating multi-perspecti…
Document SummarizationScientific Document SummarizationA Unified and Efficient Contrastive Learning Framework for Text Summarization
Both extractive and abstractive summarization systems share a common problem, i.e., there is a mismatch between the training object and evaluation metrics. To bridge this gap, we introduce a unified and efficient contra…
Abstractive Text SummarizationContrastive LearningText SummarizationThe Summary Loop: Learning to Write Abstractive Summaries Without Examples
This work presents a new approach to unsupervised abstractive summarization based on maximizing a combination of coverage and fluency for a given length constraint. It introduces a novel method that encourages the inclus…
Abstractive Text SummarizationNews Summarization