The Summary Loop: Learning to Write Abstractive Summaries Without Examples
This work presents a new approach to unsupervised abstractive summarization based on maximizing a combination of coverage and fluency for a given length constraint. It introduces a novel method that encourages the inclusion of key terms from the original document into the summary: key terms are masked out of the original document and must be filled in by a coverage model using the current generated summary. A novel unsupervised training procedure leverages this coverage model along with a fluency model to generate and score summaries. When tested on popular news summarization datasets, the method outperforms previous unsupervised methods by more than 2 R-1 points, and approaches results of competitive supervised methods. Our model attains higher levels of abstraction with copied passages roughly two times shorter than prior work, and learns to compress and merge sentences without supervision.
Code (1)
Tasks
Abstractive Text SummarizationNews SummarizationSimilar Papers 제목 키워드 기반
GEMINI: Controlling the Sentence-level Writing Style for Abstractive Text Summarization
Human experts write summaries using different techniques, including extracting a sentence from the document and rewriting it, or fusing various information from the document to abstract it. These techniques are flexible …
Abstractive Text SummarizationSentenceSentence ReWritingText SummarizationTowards Abstractive Grounded Summarization of Podcast Transcripts
Podcasts have recently shown a rapid rise in popularity. Summarization of podcast transcripts is of practical benefit to both content providers and consumers. It helps consumers to quickly decide whether they will listen…
Abstractive Text SummarizationGenerating Multiple-Length Summaries via Reinforcement Learning for Unsupervised Sentence Summarization
Sentence summarization shortens given texts while maintaining core contents of the texts. Unsupervised approaches have been studied to summarize texts without human-written summaries. However, recent unsupervised models …
Abstractive Text Summarizationreinforcement-learningReinforcement Learning (RL)Sentence+2How Ready are Pre-trained Abstractive Models and LLMs for Legal Case Judgement Summarization?
Automatic summarization of legal case judgements has traditionally been attempted by using extractive summarization methods. However, in recent years, abstractive summarization models are gaining popularity since they ca…
Abstractive Text SummarizationExtractive SummarizationText SummarizationA Unified and Efficient Contrastive Learning Framework for Text Summarization
Both extractive and abstractive summarization systems share a common problem, i.e., there is a mismatch between the training object and evaluation metrics. To bridge this gap, we introduce a unified and efficient contra…
Abstractive Text SummarizationContrastive LearningText Summarization