Sentence-level Planning for Especially Abstractive Summarization
Abstractive summarization models heavily rely on copy mechanisms, such as the pointer network or attention, to achieve good performance, measured by textual overlap with reference summaries. As a result, the generated summaries stay close to the formulations in the source document. We propose the *sentence planner* model to generate more abstractive summaries. It includes a hierarchical decoder that first generates a representation for the next summary sentence, and then conditions the word generator on this representation. Our generated summaries are more abstractive and at the same time achieve high ROUGE scores when compared to human reference summaries. We verify the effectiveness of our design decisions with extensive evaluations.
Code (1)
Tasks
Abstractive Text SummarizationDecoderSentenceSimilar Papers 제목 키워드 기반
Selective Encoding for Abstractive Sentence Summarization
We propose a selective encoding model to extend the sequence-to-sequence framework for abstractive sentence summarization. It consists of a sentence encoder, a selective gate network, and an attention equipped decoder. T…
DecoderSentenceSentence SummarizationAbstractive Unsupervised Multi-Document Summarization using Paraphrastic Sentence Fusion
In this work, we aim at developing an unsupervised abstractive summarization system in the multi-document setting. We design a paraphrastic sentence fusion model which jointly performs sentence fusion and paraphrasing us…
Abstractive Text SummarizationDocument SummarizationMachine TranslationMulti-Document Summarization+5Using Multimodal and Language-Agnostic Sentence Embeddings for Abstractive Summarization
Abstractive summarization aims to generate concise summaries by creating new sentences, allowing for flexible rephrasing. However, this approach can be vulnerable to inaccuracies, particularly `hallucinations' where the …
A Unified Model for Extractive and Abstractive Summarization using Inconsistency Loss
We propose a unified model combining the strength of extractive and abstractive summarization. On the one hand, a simple extractive model can obtain sentence-level attention with high ROUGE scores but less readable. On th…
Abstractive Text SummarizationSentenceA Unified Model for Extractive and Abstractive Summarization using Inconsistency Loss
We propose a unified model combining the strength of extractive and abstractive summarization. On the one hand, a simple extractive model can obtain sentence-level attention with high ROUGE scores but less readable. On t…
Abstractive Text SummarizationSentence