Global Encoding for Abstractive Summarization
In neural abstractive summarization, the conventional sequence-to-sequence (seq2seq) model often suffers from repetition and semantic irrelevance. To tackle the problem, we propose a global encoding framework, which controls the information flow from the encoder to the decoder based on the global information of the source context. It consists of a convolutional gated unit to perform global encoding to improve the representations of the source-side information. Evaluations on the LCSTS and the English Gigaword both demonstrate that our model outperforms the baseline models, and the analysis shows that our model is capable of reducing repetition.
Code (4)
Tasks
Abstractive Text SummarizationDecoderSimilar Papers 제목 키워드 기반
Improving Neural Abstractive Document Summarization with Explicit Information Selection Modeling
Information selection is the most important component in document summarization task. In this paper, we propose to extend the basic neural encoding-decoding framework with an information selection layer to explicitly mod…
Abstractive Text SummarizationDocument SummarizationMachine TranslationSentence+1Selective Encoding for Abstractive Sentence Summarization
We propose a selective encoding model to extend the sequence-to-sequence framework for abstractive sentence summarization. It consists of a sentence encoder, a selective gate network, and an attention equipped decoder. T…
DecoderSentenceSentence SummarizationExploring Cross-Lingual Guidance in Abstractive Summarization
Cross-lingual guidance (CLG) as an augmentation method is often applied in cross-lingual summarization (CLS) to improve its performance. In this paper, we empirically study how cross-lingual information of different qual…
Abstractive Text SummarizationNeural Abstractive Unsupervised Summarization of Online News Discussions
Summarization has usually relied on gold standard summaries to train extractive or abstractive models. Social media brings a hurdle to summarization techniques since it requires addressing a multi-document multi-author a…
Abstractive Text SummarizationUnsupervised Text SummarizationA Finer-grain Universal Dialogue Semantic Structures based Model For Abstractive Dialogue Summarization
Although abstractive summarization models have achieved impressive results on document summarization tasks, their performance on dialogue modeling is much less satisfactory due to the crude and straight methods for dialo…
Abstractive Dialogue SummarizationAbstractive Text SummarizationDocument Summarization