paper-with-me

Papers

Sparse Optimization for Unsupervised Extractive Summarization of Long Documents with the Frank-Wolfe Algorithm

2022-08-19 · EMNLP (sustainlp) 2020 11 · Alicia Y. Tsai, Laurent El Ghaoui

We address the problem of unsupervised extractive document summarization, especially for long documents. We model the unsupervised problem as a sparse auto-regression one and approximate the resulting combinatorial problem via a convex, norm-constrained problem. We solve it using a dedicated Frank-Wolfe algorithm. To generate a summary with $k$ sentences, the algorithm only needs to execute $\approx k$ iterations, making it very efficient. We explain how to avoid explicit calculation of the full gradient and how to include sentence embedding information. We evaluate our approach against two other unsupervised methods using both lexical (standard) ROUGE scores, as well as semantic (embedding-based) ones. Our method achieves better results with both datasets and works especially well when combined with embeddings for highly paraphrased summaries.

📄 PDF Abstract BibTeX arXiv:2208.09454

Code (0)

등록된 구현이 없습니다.

Tasks

Document SummarizationExtractive Document SummarizationExtractive SummarizationregressionSentenceSentence EmbeddingSentence-EmbeddingUnsupervised Extractive Summarization

Similar Papers 제목 키워드 기반

Unsupervised Extractive Opinion Summarization Using Sparse Coding

2022-03-15 · ACL 2022 5 · Somnath Basu Roy Chowdhury, Chao Zhao, Snigdha Chaturvedi

Opinion summarization is the task of automatically generating summaries that encapsulate information from multiple user reviews. We present Semantic Autoencoder (SemAE) to perform extractive opinion summarization in an u…

Dictionary LearningExtractive SummarizationOpinion SummarizationSentence

Unsupervised Dual-Cascade Learning with Pseudo-Feedback Distillation for Query-based Extractive Summarization

2018-11-01 · Haggai Roitman, Guy Feigenblat, David Konopnicki, Doron Cohen 외

We propose Dual-CES -- a novel unsupervised, query-focused, multi-document extractive summarizer. Dual-CES is designed to better handle the tradeoff between saliency and focus in summarization. To this end, Dual-CES empl…

Extractive SummarizationQuery-Based Extractive Summarization

Legal Case Document Summarization: Extractive and Abstractive Methods and their Evaluation

2022-10-14 · Abhay Shukla, Paheli Bhattacharya, Soham Poddar, Rajdeep Mukherjee 외

Summarization of legal case judgement documents is a challenging problem in Legal NLP. However, not much analyses exist on how different families of summarization models (e.g., extractive vs. abstractive) perform when ap…

Abstractive Text SummarizationDocument SummarizationOpen-Ended Question Answering

HETFORMER: Heterogeneous Transformer with Sparse Attention for Long-Text Extractive Summarization

2021-10-12 · EMNLP 2021 11 · Ye Liu, Jian-Guo Zhang, Yao Wan, Congying Xia 외

To capture the semantic graph structure from raw text, most existing summarization approaches are built on GNNs with a pre-trained model. However, these methods suffer from cumbersome procedures and inefficient computati…

Document SummarizationExtractive SummarizationMulti-Document Summarization

BottleSum: Unsupervised and Self-supervised Sentence Summarization using the Information Bottleneck Principle

2019-09-16 · IJCNLP 2019 11 · Peter West, Ari Holtzman, Jan Buys, Yejin Choi

The principle of the Information Bottleneck (Tishby et al. 1999) is to produce a summary of information X optimized to predict some other relevant information Y. In this paper, we propose a novel approach to unsupervised…

Abstractive Text SummarizationExtractive SummarizationLanguage ModelingLanguage Modelling+4