Get To The Point: Summarization with Pointer-Generator Networks
Neural sequence-to-sequence models have provided a viable new approach for abstractive text summarization (meaning they are not restricted to simply selecting and rearranging passages from the original text). However, these models have two shortcomings: they are liable to reproduce factual details inaccurately, and they tend to repeat themselves. In this work we propose a novel architecture that augments the standard sequence-to-sequence attentional model in two orthogonal ways. First, we use a hybrid pointer-generator network that can copy words from the source text via pointing, which aids accurate reproduction of information, while retaining the ability to produce novel words through the generator. Second, we use coverage to keep track of what has been summarized, which discourages repetition. We apply our model to the CNN / Daily Mail summarization task, outperforming the current abstractive state-of-the-art by at least 2 ROUGE points.
Code (39)
Tasks
Abstractive Text SummarizationDocument SummarizationExtractive Text SummarizationText SummarizationSimilar Papers 제목 키워드 기반
A more abstractive summarization model
Pointer-generator network is an extremely popular method of text summarization. More recent works in this domain still build on top of the baseline pointer generator by augmenting a content selection phase, or by decompo…
Abstractive Text SummarizationDecoderLanguage ModelingLanguage Modelling+2Point-less: More Abstractive Summarization with Pointer-Generator Networks
The Pointer-Generator architecture has shown to be a big improvement for abstractive summarization seq2seq models. However, the summaries produced by this model are largely extractive as over 30% of the generated sentenc…
Abstractive Text SummarizationNeural Abstractive Text Summarization and Fake News Detection
In this work, we study abstractive text summarization by exploring different models such as LSTM-encoder-decoder with attention, pointer-generator networks, coverage mechanisms, and transformers. Upon extensive and caref…
Abstractive Text SummarizationArticlesClassificationDecoder+3MAPGN: MAsked Pointer-Generator Network for sequence-to-sequence pre-training
This paper presents a self-supervised learning method for pointer-generator networks to improve spoken-text normalization. Spoken-text normalization that converts spoken-style text into style normalized text is becoming …
Machine TranslationSelf-Supervised LearningText NormalizationPointer over Attention: An Improved Bangla Text Summarization Approach Using Hybrid Pointer Generator Network
Despite the success of the neural sequence-to-sequence model for abstractive text summarization, it has a few shortcomings, such as repeating inaccurate factual details and tending to repeat themselves. We propose a hybr…
Abstractive Text SummarizationArticlesText Summarization