Improving Abstractive Text Summarization with History Aggregation
Recent neural sequence to sequence models have provided feasible solutions for abstractive summarization. However, such models are still hard to tackle long text dependency in the summarization task. A high-quality summarization system usually depends on strong encoder which can refine important information from long input texts so that the decoder can generate salient summaries from the encoder's memory. In this paper, we propose an aggregation mechanism based on the Transformer model to address the challenge of long text representation. Our model can review history information to make encoder hold more memory capacity. Empirically, we apply our aggregation mechanism to the Transformer model and experiment on CNN/DailyMail dataset to achieve higher quality summaries compared to several strong baseline models on the ROUGE metrics.
Code (0)
등록된 구현이 없습니다.
Tasks
Abstractive Text SummarizationDecoderText SummarizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Learn to Copy from the Copying History: Correlational Copy Network for Abstractive Summarization
The copying mechanism has had considerable success in abstractive summarization, facilitating models to directly copy words from the input text to the output summary. Existing works mostly employ encoder-decoder attentio…
Abstractive Text SummarizationDecoderNews SummarizationSource-summary Entity Aggregation in Abstractive Summarization
In a text, entities mentioned earlier can be referred to in later discourse by a more general description. For example, Celine Dion and Justin Bieber can be referred to by Canadian singers or celebrities. In this work, w…
Abstractive Text SummarizationTESA: A Task in Entity Semantic Aggregation for Abstractive Summarization
Human-written texts contain frequent generalizations and semantic aggregation of content. In a document, they may refer to a pair of named entities such as {`}London{'} and {`}Paris{'} with different expressions: {``}the…
Abstractive Text SummarizationDecoderLanguage ModelingLanguage ModellingNeural Abstractive Text Summarizer for Telugu Language
Abstractive Text Summarization is the process of constructing semantically relevant shorter sentences which captures the essence of the overall meaning of the source text. It is actually difficult and very time consuming…
Abstractive Text SummarizationDecoderDeep LearningSentence+1Unsupervised Abstractive Summarization of Bengali Text Documents
Abstractive summarization systems generally rely on large collections of document-summary pairs. However, the performance of abstractive systems remains a challenge due to the unavailability of parallel data for low-reso…
Abstractive Text SummarizationExtractive SummarizationLanguage ModelingLanguage Modelling+2