Sparse Optimization for Unsupervised Extractive Summarization of Long Documents with the Frank-Wolfe Algorithm
We address the problem of unsupervised extractive document summarization, especially for long documents. We model the unsupervised problem as a sparse auto-regression one and approximate the resulting combinatorial problem via a convex, norm-constrained problem. We solve it using a dedicated Frank-Wolfe algorithm. To generate a summary with $k$ sentences, the algorithm only needs to execute $\approx k$ iterations, making it very efficient. We explain how to avoid explicit calculation of the full gradient and how to include sentence embedding information. We evaluate our approach against two other unsupervised methods using both lexical (standard) ROUGE scores, as well as semantic (embedding-based) ones. Our method achieves better results with both datasets and works especially well when combined with embeddings for highly paraphrased summaries.
Code (0)
등록된 구현이 없습니다.
Tasks
Document SummarizationExtractive Document SummarizationExtractive SummarizationregressionSentenceSentence EmbeddingSentence-EmbeddingUnsupervised Extractive SummarizationSimilar Papers 제목 키워드 기반
Unsupervised Extractive Opinion Summarization Using Sparse Coding
Opinion summarization is the task of automatically generating summaries that encapsulate information from multiple user reviews. We present Semantic Autoencoder (SemAE) to perform extractive opinion summarization in an u…
Dictionary LearningExtractive SummarizationOpinion SummarizationSentenceUnsupervised Dual-Cascade Learning with Pseudo-Feedback Distillation for Query-based Extractive Summarization
We propose Dual-CES -- a novel unsupervised, query-focused, multi-document extractive summarizer. Dual-CES is designed to better handle the tradeoff between saliency and focus in summarization. To this end, Dual-CES empl…
Extractive SummarizationQuery-Based Extractive SummarizationLegal Case Document Summarization: Extractive and Abstractive Methods and their Evaluation
Summarization of legal case judgement documents is a challenging problem in Legal NLP. However, not much analyses exist on how different families of summarization models (e.g., extractive vs. abstractive) perform when ap…
Abstractive Text SummarizationDocument SummarizationOpen-Ended Question AnsweringHETFORMER: Heterogeneous Transformer with Sparse Attention for Long-Text Extractive Summarization
To capture the semantic graph structure from raw text, most existing summarization approaches are built on GNNs with a pre-trained model. However, these methods suffer from cumbersome procedures and inefficient computati…
Document SummarizationExtractive SummarizationMulti-Document SummarizationBottleSum: Unsupervised and Self-supervised Sentence Summarization using the Information Bottleneck Principle
The principle of the Information Bottleneck (Tishby et al. 1999) is to produce a summary of information X optimized to predict some other relevant information Y. In this paper, we propose a novel approach to unsupervised…
Abstractive Text SummarizationExtractive SummarizationLanguage ModelingLanguage Modelling+4