Learning Syntactic and Dynamic Selective Encoding for Document Summarization
Text summarization aims to generate a headline or a short summary consisting of the major information of the source text. Recent studies employ the sequence-to-sequence framework to encode the input with a neural network and generate abstractive summary. However, most studies feed the encoder with the semantic word embedding but ignore the syntactic information of the text. Further, although previous studies proposed the selective gate to control the information flow from the encoder to the decoder, it is static during the decoding and cannot differentiate the information based on the decoder states. In this paper, we propose a novel neural architecture for document summarization. Our approach has the following contributions: first, we incorporate syntactic information such as constituency parsing trees into the encoding sequence to learn both the semantic and syntactic information from the document, resulting in more accurate summary; second, we propose a dynamic gate network to select the salient information based on the context of the decoder state, which is essential to document summarization. The proposed model has been evaluated on CNN/Daily Mail summarization datasets and the experimental results show that the proposed approach outperforms baseline approaches.
Code (0)
등록된 구현이 없습니다.
Tasks
Constituency ParsingDecoderDocument SummarizationText SummarizationSimilar Papers 제목 키워드 기반
Selective Attention Encoders by Syntactic Graph Convolutional Networks for Document Summarization
Abstractive text summarization is a challenging task, and one need to design a mechanism to effectively extract salient information from the source text and then generate a summary. A parsing process of the source text c…
Abstractive Text SummarizationDocument SummarizationText SummarizationDocument-aware Positional Encoding and Linguistic-guided Encoding for Abstractive Multi-document Summarization
One key challenge in multi-document summarization is to capture the relations among input documents that distinguish between single document summarization (SDS) and multi-document summarization (MDS). Few existing MDS wo…
Document SummarizationMulti-Document SummarizationTopic-Aware Encoding for Extractive Summarization
Document summarization provides an instrument for faster understanding the collection of text documents and has several real-life applications. With the growth of online text data, numerous summarization models have been…
Document SummarizationExtractive SummarizationRepresentation LearningSentenceCode Representation Learning with Prüfer Sequences
An effective and efficient encoding of the source code of a computer program is critical to the success of sequence-to-sequence deep neural network models for tasks in computer program comprehension, such as automated co…
Code SummarizationRepresentation LearningSelective Encoding for Abstractive Sentence Summarization
We propose a selective encoding model to extend the sequence-to-sequence framework for abstractive sentence summarization. It consists of a sentence encoder, a selective gate network, and an attention equipped decoder. T…
DecoderSentenceSentence Summarization