Unsupervised Summarization by Jointly Extracting Sentences and Keywords
We present RepRank, an unsupervised graph-based ranking model for extractive multi-document summarization in which the similarity between words, sentences, and word-to-sentence can be estimated by the distances between their vector representations in a unified vector space. In order to obtain desirable representations, we propose a self-attention based learning method that represent a sentence by the weighted sum of its word embeddings, and the weights are concentrated to those words hopefully better reflecting the content of a document. We show that salient sentences and keywords can be extracted in a joint and mutual reinforcement process using our learned representations, and prove that this process always converges to a unique solution leading to improvement in performance. A variant of absorbing random walk and the corresponding sampling-based algorithm are also described to avoid redundancy and increase diversity in the summaries. Experiment results with multiple benchmark datasets show that RepRank achieved the best or comparable performance in ROUGE.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversityDocument SummarizationMulti-Document SummarizationSentenceWord EmbeddingsSimilar Papers 제목 키워드 기반
Neural Document Summarization by Jointly Learning to Score and Select Sentences
Sentence scoring and sentence selection are two main steps in extractive document summarization systems. However, previous works treat them as two separated subtasks. In this paper, we present a novel end-to-end neural n…
Document SummarizationExtractive Document SummarizationExtractive SummarizationExtractive Text Summarization+1RankSum An unsupervised extractive text summarization based on rank fusion
In this paper, we propose Ranksum, an approach for extractive text summarization of single documents based on the rank fusion of four multi-dimensional sentence features extracted for each sentence: topic information, se…
Extractive Text SummarizationSentenceSentence EmbeddingsText Summarization+1Centrality Meets Centroid: A Graph-based Approach for Unsupervised Document Summarization
Unsupervised document summarization has re-acquired lots of attention in recent years thanks to its simplicity and data independence. In this paper, we propose a graph-based unsupervised approach for extractive document …
Document SummarizationExtractive Document SummarizationSentenceUnsupervised Extractive Summarization with Heterogeneous Graph Embeddings for Chinese Document
In the scenario of unsupervised extractive summarization, learning high-quality sentence representations is essential to select salient sentences from the input document. Previous studies focus more on employing statisti…
Extractive SummarizationSentenceSentence EmbeddingsUnsupervised Extractive SummarizationConceptual Text Summarizer: A new model in continuous vector space
Traditional methods of summarization are not cost-effective and possible today. Extractive summarization is a process that helps to extract the most important sentences from a text automatically and generates a short inf…
Extractive Summarization