Jointly Extracting and Compressing Documents with Summary State Representations
We present a new neural model for text summarization that first extracts sentences from a document and then compresses them. The proposed model offers a balance that sidesteps the difficulties in abstractive methods while generating more concise summaries than extractive methods. In addition, our model dynamically determines the length of the output summary based on the gold summaries it observes during training and does not require length constraints typical to extractive summarization. The model achieves state-of-the-art results on the CNN/DailyMail and Newsroom datasets, improving over current extractive and abstractive methods. Human evaluations demonstrate that our model generates concise and informative summaries. We also make available a new dataset of oracle compressive summaries derived automatically from the CNN/DailyMail reference summaries.
Code (1)
Tasks
Extractive SummarizationText SummarizationSimilar Papers 제목 키워드 기반
Adapting Language Models to Compress Contexts
Transformer-based language models (LMs) are powerful and widely-applicable tools, but their usefulness is constrained by a finite context window and the expensive computational cost of processing long text documents. We …
In-Context LearningLanguage ModelingLanguage ModellingPassage Re-Ranking+2Extracting Summary Knowledge Graphs from Long Documents
Knowledge graphs capture entities and relations from long documents and can facilitate reasoning in many downstream applications. Extracting compact knowledge graphs containing only salient entities and relations is impo…
Graph LearningKnowledge GraphsText SummarizationMulti-Topic Multi-Document Summarizer
Current multi-document summarization systems can successfully extract summary sentences, however with many limitations including: low coverage, inaccurate extraction to important sentences, redundancy and poor coherence …
Document SummarizationMulti-Document SummarizationEvaluation of Review Summaries via Question-Answering
Summarisation of reviews aims at compressing opinions expressed in multiple review documents into a concise form while still covering the key opinions. Despite the advancement in summarisation models, evaluation metrics …
Question AnsweringLong Document Summarization in a Low Resource Setting using Pretrained Language Models
Abstractive summarization is the task of compressing a long document into a coherent short document while retaining salient information. Modern abstractive summarization methods are based on deep neural networks which of…
Abstractive Text SummarizationDocument SummarizationLanguage ModelingLanguage Modelling