Reinforced Generative Adversarial Network for Abstractive Text Summarization
Sequence-to-sequence models provide a viable new approach to generative summarization, allowing models that are no longer limited to simply selecting and recombining sentences from the original text. However, these models have three drawbacks: their grasp of the details of the original text is often inaccurate, and the text generated by such models often has repetitions, while it is difficult to handle words that are beyond the word list. In this paper, we propose a new architecture that combines reinforcement learning and adversarial generative networks to enhance the sequence-to-sequence attention model. First, we use a hybrid pointer-generator network that copies words directly from the source text, contributing to accurate reproduction of information without sacrificing the ability of generators to generate new words. Second, we use both intra-temporal and intra-decoder attention to penalize summarized content and thus discourage repetition. We apply our model to our own proposed COVID-19 paper title summarization task and achieve close approximations to the current model on ROUEG, while bringing better readability.
Code (0)
등록된 구현이 없습니다.
Tasks
Abstractive Text SummarizationDecoderGenerative Adversarial NetworkText SummarizationSimilar Papers 제목 키워드 기반
Generative Adversarial Network for Abstractive Text Summarization
In this paper, we propose an adversarial process for abstractive text summarization, in which we simultaneously train a generative model G and a discriminative model D. In particular, we build the generator G as an agent…
Abstractive Text SummarizationGenerative Adversarial Networkreinforcement-learningReinforcement Learning+2Semantic-Preserving Abstractive Text Summarization with Siamese Generative Adversarial Net
We propose a novel siamese generative adversarial net for abstractive text summarization (SSPGAN), which can preserve the main semantics of the source text. Different from previous generative adversarial net based method…
Abstractive Text SummarizationText SummarizationRewards with Negative Examples for Reinforced Topic-Focused Abstractive Summarization
We consider the problem of topic-focused abstractive summarization, where the goal is to generate an abstractive summary focused on a particular topic, a phrase of one or multiple words. We hypothesize that the task of g…
Abstractive Text SummarizationDeep Reinforcement LearningReinforcement Learning (RL)Aspect and Opinion Aware Abstractive Review Summarization with Reinforced Hard Typed Decoder
In this paper, we study abstractive review summarization.Observing that review summaries often consist of aspect words, opinion words and context words, we propose a two-stage reinforcement learning approach, which first…
Decoderreinforcement-learningReinforcement LearningReinforcement Learning (RL)Reinforced Abstractive Summarization with Adaptive Length Controlling
Document summarization, as a fundamental task in natural language generation, aims to generate a short and coherent summary for a given document. Controllable summarization, especially of the length, is an important issu…
Abstractive Text SummarizationDocument SummarizationSaliency PredictionSentence+1