paper-with-me

홈 › Papers

On the Trade-off between Redundancy and Local Coherence in Summarization

2022-05-20 · Ronald Cardenas, Matthias Galle, Shay B. Cohen

Extractive summaries are usually presented as lists of sentences with no expected cohesion between them and with plenty of redundant information if not accounted for. In this paper, we investigate the trade-offs incurred when aiming to control for inter-sentential cohesion and redundancy in extracted summaries, and their impact on their informativeness. As case study, we focus on the summarization of long, highly redundant documents and consider two optimization scenarios, reward-guided and with no supervision. In the reward-guided scenario, we compare systems that control for redundancy and cohesion during sentence scoring. In the unsupervised scenario, we introduce two systems that aim to control all three properties -- informativeness, redundancy, and cohesion -- in a principled way. Both systems implement a psycholinguistic theory that simulates how humans keep track of relevant content units and how cohesion and non-redundancy constraints are applied in short-term memory during reading. Extensive automatic and human evaluations reveal that systems optimizing for -- among other properties -- cohesion are capable of better organizing content in summaries compared to systems that optimize only for redundancy, while maintaining comparable informativeness. We find that the proposed unsupervised systems manage to extract highly cohesive summaries across varying levels of document redundancy, although sacrificing informativeness in the process. Finally, we lay evidence as to how simulated cognitive processes impact the trade-off between the analyzed summary properties.

📄 PDF Abstract BibTeX arXiv:2205.10192

Code (1)

ronaldahmed/redundancy-kvd 공식 구현

Tasks

Extractive SummarizationInformativenessReading ComprehensionSentenceUnsupervised Extractive Summarization

Similar Papers 제목 키워드 기반

Enhancing Annotated Bibliography Generation with LLM Ensembles

2024-12-30 · Sergio Bermejo

This work proposes a novel approach to enhancing annotated bibliography generation through Large Language Model (LLM) ensembles. In particular, multiple LLMs in different roles -- controllable text generation, evaluation…

DiversityLanguage ModelingLanguage ModellingLarge Language Model+1

SumPubMed: Summarization Dataset of PubMed Scientific Articles

2021-08-01 · ACL 2021 5 · Vivek Gupta, Prerna Bharti, Pegah Nokhiz, Harish Karnick

Most earlier work on text summarization is carried out on news article datasets. The summary in these datasets is naturally located at the beginning of the text. Hence, a model can spuriously utilize this correlation for…

ArticlesInformativenessText Summarization

Decoupling Generation and Selection for Budget-Constrained Faithful Summarization

2026-08-04 · Zeyu Wang, Guanghua Wang, Meng Xu arxiv

Abstractive summarization models remain vulnerable to factual inconsistency, redundancy, and weak length control. We propose a modular generation-and-selection framework for sentence-budget-constrained summarization. A p…

Multi-Document Summarization

SNaC: Coherence Error Detection for Narrative Summarization

2022-05-19 · Tanya Goyal, Junyi Jessy Li, Greg Durrett

Progress in summarizing long texts is inhibited by the lack of appropriate evaluation frameworks. When a long summary must be produced to appropriately cover the facets of that text, that summary needs to present a coher…

BenchmarkingCoherence EvaluationDocument Summarization

Context-Aware Pseudo-Label Scoring for Zero-Shot Video Summarization

2025-10-20 · Yuanli Wu, Long Zhang, Yue Du, Bin Li arxiv

We propose a rubric-guided, pseudo-labeled, and prompt-driven zero-shot video summarization framework that bridges large language models with structured semantic reasoning. A small subset of human annotations is converte…

Video Summarization