On Extractive and Abstractive Neural Document Summarization with Transformer Language Models
We present a method to produce abstractive summaries of long documents that exceed several thousand words via neural abstractive summarization. We perform a simple extractive step before generating a summary, which is then used to condition the transformer language model on relevant information before being tasked with generating a summary. We show that this extractive step significantly improves summarization results. We also show that this approach produces more abstractive summaries compared to prior work that employs a copy mechanism while still achieving higher rouge scores. Note: The abstract above was not written by the authors, it was generated by one of the models presented in this paper.
Code (1)
Tasks
Abstractive Text SummarizationDocument SummarizationLanguage ModelingLanguage ModellingText SummarizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Combination of abstractive and extractive approaches for summarization of long scientific texts
In this research work, we present a method to generate summaries of long scientific documents that uses the advantages of both extractive and abstractive approaches. Before producing a summary in an abstractive manner, w…
Legal Case Document Summarization: Extractive and Abstractive Methods and their Evaluation
Summarization of legal case judgement documents is a challenging problem in Legal NLP. However, not much analyses exist on how different families of summarization models (e.g., extractive vs. abstractive) perform when ap…
Abstractive Text SummarizationDocument SummarizationOpen-Ended Question AnsweringText Summarization with Pretrained Encoders
Bidirectional Encoder Representations from Transformers (BERT) represents the latest incarnation of pretrained language models which have recently advanced a wide range of natural language processing tasks. In this paper…
Abstractive Text SummarizationDecoderDocument SummarizationExtractive Document Summarization+3BERT Fine-tuning For Arabic Text Summarization
Fine-tuning a pretrained BERT model is the state of the art method for extractive/abstractive text summarization, in this paper we showcase how this fine-tuning method can be applied to the Arabic language to both constr…
Abstractive Text SummarizationExtractive SummarizationText SummarizationTeam AINLPML @ MuP in SDP 2021: Scientific Document Summarization by End-to-End Extractive and Abstractive Approach
This paper introduces the proposed summarization system of the AINLPML team for the First Shared Task on Multi-Perspective Scientific Document Summarization at SDP 2022. We present a method to produce abstractive summari…
Document SummarizationExtractive SummarizationLanguage ModelingLanguage Modelling+2