Improving Abstractive Summarization with Commonsense Knowledge
Large scale pretrained models have demonstrated strong performances on several natural language generation and understanding benchmarks. However, introducing commonsense into them to generate more realistic text remains a challenge. Inspired from previous work on commonsense knowledge generation and generative commonsense reasoning, we introduce two methods to add commonsense reasoning skills and knowledge into abstractive summarization models. Both methods beat the baseline on ROUGE scores, demonstrating the superiority of our models over the baseline. Human evaluation results suggest that summaries generated by our methods are more realistic and have fewer commonsensical errors.
Code (0)
등록된 구현이 없습니다.
Tasks
Abstractive Text SummarizationText GenerationSimilar Papers 제목 키워드 기반
Incorporating Commonsense Knowledge into Abstractive Dialogue Summarization via Heterogeneous Graph Networks
Abstractive dialogue summarization is the task of capturing the highlights of a dialogue and rewriting them into a concise version. In this paper, we present a novel multi-speaker dialogue summarizer to demonstrate how l…
Abstractive Dialogue Summarizationdialogue summaryDialogue UnderstandingMind the Gap! Injecting Commonsense Knowledge for Abstractive Dialogue Summarization
In this paper, we propose to leverage the unique characteristics of dialogues sharing commonsense knowledge across participants, to resolve the difficulties in summarizing them. We present SICK, a framework that uses com…
Abstractive Dialogue SummarizationMulti-Task LearningText SummarizationMind The Facts: Knowledge-Boosted Coherent Abstractive Text Summarization
Neural models have become successful at producing abstractive summaries that are human-readable and fluent. However, these models have two critical shortcomings: they often don't respect the facts that are either include…
Abstractive Text SummarizationDecoderLanguage ModelingLanguage Modelling+2Knowledge and Keywords Augmented Abstractive Sentence Summarization
In this paper, we study the abstractive sentence summarization. There are two essential information features that can influence the quality of news summarization, which are topic keywords and the knowledge structure of t…
News SummarizationSentenceSentence SummarizationEnhancing Abstractiveness of Summarization Models through Calibrated Distillation
Sequence-level knowledge distillation reduces the size of Seq2Seq models for more efficient abstractive summarization. However, it often leads to a loss of abstractiveness in summarization. In this paper, we propose a no…
Abstractive Text SummarizationInformativenessKnowledge Distillation