Topic-Guided Abstractive Text Summarization: a Joint Learning Approach
We introduce a new approach for abstractive text summarization, Topic-Guided Abstractive Summarization, which calibrates long-range dependencies from topic-level features with globally salient content. The idea is to incorporate neural topic modeling with a Transformer-based sequence-to-sequence (seq2seq) model in a joint learning framework. This design can learn and preserve the global semantics of the document, which can provide additional contextual guidance for capturing important ideas of the document, thereby enhancing the generation of summary. We conduct extensive experiments on two datasets and the results show that our proposed model outperforms many extractive and abstractive systems in terms of both ROUGE measurements and human evaluation. Our code is available at: https://github.com/chz816/tas.
Code (1)
Tasks
Abstractive Text SummarizationExtractive SummarizationText SummarizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Topic-Guided Abstractive Multi-Document Summarization
A critical point of multi-document summarization (MDS) is to learn the relations among various documents. In this paper, we propose a novel abstractive MDS model, in which we represent multiple documents as a heterogeneo…
Document SummarizationGraph-to-SequenceMulti-Document SummarizationMulti-Task LearningRewards with Negative Examples for Reinforced Topic-Focused Abstractive Summarization
We consider the problem of topic-focused abstractive summarization, where the goal is to generate an abstractive summary focused on a particular topic, a phrase of one or multiple words. We hypothesize that the task of g…
Abstractive Text SummarizationDeep Reinforcement LearningReinforcement Learning (RL)CATS: Customizable Abstractive Topic-based Summarization
Neural sequence-to-sequence models are a recently proposed family of approaches used in abstractive summarization of text documents, useful for producing condensed versions of source text narratives without being restric…
Abstractive Text SummarizationA Reinforced Topic-Aware Convolutional Sequence-to-Sequence Model for Abstractive Text Summarization
In this paper, we propose a deep learning approach to tackle the automatic summarization tasks by incorporating topic information into the convolutional sequence-to-sequence (ConvS2S) model and using self-critical sequen…
Abstractive Text SummarizationDiversityInformativenessText SummarizationKnowledge and Keywords Augmented Abstractive Sentence Summarization
In this paper, we study the abstractive sentence summarization. There are two essential information features that can influence the quality of news summarization, which are topic keywords and the knowledge structure of t…
News SummarizationSentenceSentence Summarization