Concept Pointer Network for Abstractive Summarization
A quality abstractive summary should not only copy salient source texts as summaries but should also tend to generate new conceptual words to express concrete details. Inspired by the popular pointer generator sequence-to-sequence model, this paper presents a concept pointer network for improving these aspects of abstractive summarization. The network leverages knowledge-based, context-aware conceptualizations to derive an extended set of candidate concepts. The model then points to the most appropriate choice using both the concept set and original source text. This joint approach generates abstractive summaries with higher-level semantic concepts. The training model is also optimized in a way that adapts to different data, which is based on a novel method of distantly-supervised learning guided by reference summaries and testing set. Overall, the proposed approach provides statistically significant improvements over several state-of-the-art models on both the DUC-2004 and Gigaword datasets. A human evaluation of the model's abstractive abilities also supports the quality of the summaries produced within this framework.
Code (1)
Tasks
Abstractive Text SummarizationText SummarizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Neural Abstractive Text Summarization and Fake News Detection
In this work, we study abstractive text summarization by exploring different models such as LSTM-encoder-decoder with attention, pointer-generator networks, coverage mechanisms, and transformers. Upon extensive and caref…
Abstractive Text SummarizationArticlesClassificationDecoder+3Multi-stage Pretraining for Abstractive Summarization
Neural models for abstractive summarization tend to achieve the best performance in the presence of highly specialized, summarization specific modeling add-ons such as pointer-generator, coverage-modeling, and inferencet…
Abstractive Text SummarizationFormPoint-less: More Abstractive Summarization with Pointer-Generator Networks
The Pointer-Generator architecture has shown to be a big improvement for abstractive summarization seq2seq models. However, the summaries produced by this model are largely extractive as over 30% of the generated sentenc…
Abstractive Text SummarizationPointer over Attention: An Improved Bangla Text Summarization Approach Using Hybrid Pointer Generator Network
Despite the success of the neural sequence-to-sequence model for abstractive text summarization, it has a few shortcomings, such as repeating inaccurate factual details and tending to repeat themselves. We propose a hybr…
Abstractive Text SummarizationArticlesText SummarizationVAE-PGN based Abstractive Model in Multi-stage Architecture for Text Summarization
This paper describes our submission to the TL;DR challenge. Neural abstractive summarization models have been successful in generating fluent and consistent summaries with advancements like the copy (Pointer-generator) a…
Abstractive Text SummarizationExtractive SummarizationSentenceText Summarization