Improving Neural Abstractive Document Summarization with Explicit Information Selection Modeling
Information selection is the most important component in document summarization task. In this paper, we propose to extend the basic neural encoding-decoding framework with an information selection layer to explicitly model and optimize the information selection process in abstractive document summarization. Specifically, our information selection layer consists of two parts: gated global information filtering and local sentence selection. Unnecessary information in the original document is first globally filtered, then salient sentences are selected locally while generating each summary sentence sequentially. To optimize the information selection process directly, distantly-supervised training guided by the golden summary is also imported. Experimental results demonstrate that the explicit modeling and optimizing of the information selection process improves document summarization performance significantly, which enables our model to generate more informative and concise summaries, and thus significantly outperform state-of-the-art neural abstractive methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Abstractive Text SummarizationDocument SummarizationMachine TranslationSentenceText GenerationSimilar Papers 제목 키워드 기반
StructSum: Summarization via Structured Representations
Abstractive text summarization aims at compressing the information of a long source document into a rephrased, condensed summary. Despite advances in modeling techniques, abstractive summarization models still suffer fro…
Abstractive Text SummarizationDecoderDocument SummarizationSentence+1A Robust Abstractive System for Cross-Lingual Summarization
We present a robust neural abstractive summarization system for cross-lingual summarization. We construct summarization corpora for documents automatically translated from three low-resource languages, Somali, Swahili, a…
Abstractive Text SummarizationMachine TranslationTranslationA Survey on Neural Abstractive Summarization Methods and Factual Consistency of Summarization
Automatic summarization is the process of shortening a set of textual data computationally, to create a subset (a summary) that represents the most important pieces of information in the original text. Existing summariza…
Abstractive Text SummarizationLeveraging Attribute Conditioning for Abstractive Multi Document Summarization
Abstractive multi document summarization has evolved as a task through the basic sequence to sequence approaches to transformer and graph based techniques. Each of these approaches has primarily focused on the issues of …
AttributeDocument SummarizationMulti-Document SummarizationImproving Abstractive Document Summarization with Salient Information Modeling
Comprehensive document encoding and salient information selection are two major difficulties for generating summaries with adequate salient information. To tackle the above difficulties, we propose a Transformer-based en…
DecoderDocument Summarization