Towards Improving Abstractive Summarization via Entailment Generation
Abstractive summarization, the task of rewriting and compressing a document into a short summary, has achieved considerable success with neural sequence-to-sequence models. However, these models can still benefit from stronger natural language inference skills, since a correct summary is logically entailed by the input document, i.e., it should not contain any contradictory or unrelated information. We incorporate such knowledge into an abstractive summarization model via multi-task learning, where we share its decoder parameters with those of an entailment generation model. We achieve promising initial improvements based on multiple metrics and datasets (including a test-only setting). The domain mismatch between the entailment (captions) and summarization (news) datasets suggests that the model is learning some domain-agnostic inference skills.
Code (0)
등록된 구현이 없습니다.
Tasks
Abstractive Text SummarizationDecoderMachine TranslationMulti-Task LearningNatural Language InferenceSimilar Papers 제목 키워드 기반
Ensure the Correctness of the Summary: Incorporate Entailment Knowledge into Abstractive Sentence Summarization
In this paper, we investigate the sentence summarization task that produces a summary from a source sentence. Neural sequence-to-sequence models have gained considerable success for this task, while most existing approac…
Abstractive Text SummarizationDecoderInformativenessSentence+3Soft Layer-Specific Multi-Task Summarization with Entailment and Question Generation
An accurate abstractive summary of a document should contain all its salient information and should be logically entailed by the input document. We improve these important aspects of abstractive summarization via multi-t…
Abstractive Text SummarizationDecoderMulti-Task LearningQuestion Generation+1OpineSum: Entailment-based self-training for abstractive opinion summarization
A typical product or place often has hundreds of reviews, and summarization of these texts is an important and challenging problem. Recent progress on abstractive summarization in domains such as news has been driven by …
Abstractive Text SummarizationArticlesFew-Shot LearningNatural Language Inference+1Abstractive Meeting Summarization with Entailment and Fusion
AgreeSum: Agreement-Oriented Multi-Document Summarization
We aim to renew interest in a particular multi-document summarization (MDS) task which we call AgreeSum: agreement-oriented multi-document summarization. Given a cluster of articles, the goal is to provide abstractive su…
Abstractive Text SummarizationArticlesDocument SummarizationMulti-Document Summarization