Inducing Document Structure for Aspect-based Summarization
Automatic summarization is typically treated as a 1-to-1 mapping from document to summary. Documents such as news articles, however, are structured and often cover multiple topics or aspects; and readers may be interested in only some of them. We tackle the task of aspect-based summarization, where, given a document and a target aspect, our models generate a summary centered around the aspect. We induce latent document structure jointly with an abstractive summarization objective, and train our models in a scalable synthetic setup. In addition to improvements in summarization over topic-agnostic baselines, we demonstrate the benefit of the learnt document structure: we show that our models (a) learn to accurately segment documents by aspect; (b) can leverage the structure to produce both abstractive and extractive aspect-based summaries; and (c) that structure is particularly advantageous for summarizing long documents. All results transfer from synthetic training documents to natural news articles from CNN/Daily Mail and RCV1.
Code (1)
Tasks
Abstractive Text SummarizationArticlesSimilar Papers 제목 키워드 기반
Zero-Shot Aspect-Based Scientific Document Summarization using Self-Supervised Pre-training
We study the zero-shot setting for the aspect-based scientific document summarization task. Summarizing scientific documents with respect to an aspect can remarkably improve document assistance systems and readers experi…
Document SummarizationScientific Document SummarizationOpenAsp: A Benchmark for Multi-document Open Aspect-based Summarization
The performance of automatic summarization models has improved dramatically in recent years. Yet, there is still a gap in meeting specific information needs of users in real-world scenarios, particularly when a targeted …
Document SummarizationMulti-Document SummarizationZero-Shot Aspect-Based Scientific Document Summarization using Self-Supervised Pre-training
We study the zero-shot setting for the aspect-based scientific document summarization task. Summarizing scientific documents with respect to an aspect can remarkably improve document assistance systems and readers experi…
Document SummarizationScientific Document SummarizationInducing Causal Structure for Abstractive Text Summarization
The mainstream of data-driven abstractive summarization models tends to explore the correlations rather than the causal relationships. Among such correlations, there can be spurious ones which suffer from the language pr…
Abstractive Text SummarizationText SummarizationLexAbSumm: Aspect-based Summarization of Legal Decisions
Legal professionals frequently encounter long legal judgments that hold critical insights for their work. While recent advances have led to automated summarization solutions for legal documents, they typically provide ge…
Abstractive Text Summarization