Entity-based SpanCopy for Abstractive Summarization to Improve the Factual Consistency
Despite the success of recent abstractive summarizers on automatic evaluation metrics, the generated summaries still present factual inconsistencies with the source document. In this paper, we focus on entity-level factual inconsistency, i.e. reducing the mismatched entities between the generated summaries and the source documents. We therefore propose a novel entity-based SpanCopy mechanism, and explore its extension with a Global Relevance component. Experiment results on four summarization datasets show that SpanCopy can effectively improve the entity-level factual consistency with essentially no change in the word-level and entity-level saliency. The code is available at https://github.com/Wendy-Xiao/Entity-based-SpanCopy
Code (1)
Tasks
Abstractive Text SummarizationSimilar Papers 제목 키워드 기반
Entity-level Factual Consistency of Abstractive Text Summarization
A key challenge for abstractive summarization is ensuring factual consistency of the generated summary with respect to the original document. For example, state-of-the-art models trained on existing datasets exhibit enti…
Abstractive Text SummarizationHallucinationText SummarizationHallucinated but Factual! Inspecting the Factuality of Hallucinations in Abstractive Summarization
State-of-the-art abstractive summarization systems often generate hallucinations; i.e., content that is not directly inferable from the source text. Despite being assumed to be incorrect, we find that much hallucinated c…
Abstractive Text SummarizationReinforcement Learning (RL)World KnowledgeImproving Factual Consistency of Abstractive Summarization on Customer Feedback
E-commerce stores collect customer feedback to let sellers learn about customer concerns and enhance customer order experience. Because customer feedback often contains redundant information, a concise summary of the fee…
Abstractive Text SummarizationText SummarizationHallucinated but Factual! Inspecting the Factuality of Hallucinations in Abstractive Summarization
State-of-the-art abstractive summarization systems often generate \emph{hallucinations}; i.e., content that is not directly inferable from the source text. Despite being assumed incorrect, we find that much hallucinated …
Abstractive Text SummarizationReinforcement Learning (RL)World KnowledgeEntity-driven Fact-aware Abstractive Summarization of Biomedical Literature
As part of the large number of scientific articles being published every year, the publication rate of biomedical literature has been increasing. Consequently, there has been considerable effort to harness and summarize …
Abstractive Text SummarizationArticlesDecoderDocument Summarization+1