GUSUM: Graph-based Unsupervised Summarization Using Sentence Features Scoring and Sentence-BERT
Unsupervised extractive document summarization aims to extract salient sentences from a document without requiring a labelled corpus. In existing graph-based methods, vertex and edge weights are usually created by calculating sentence similarities. In this paper, we develop a Graph-Based Unsupervised Summarization(GUSUM) method for extractive text summarization based on the principle of including the most important sentences while excluding sentences with similar meanings in the summary. We modify traditional graph ranking algorithms with recent sentence embedding models and sentence features and modify how sentence centrality is computed. We first define the sentence feature scores represented at the vertices, indicating the importance of each sentence in the document. After this stage, we use Sentence-BERT for obtaining sentence embeddings to better capture the sentence meaning. In this way, we define the edges of a graph where semantic similarities are represented. Next we create an undirected graph that includes sentence significance and similarities between sentences. In the last stage, we determine the most important sentences in the document with the ranking method we suggested on the graph created. Experiments on CNN/Daily Mail, New York Times, arXiv, and PubMed datasets show our approach achieves high performance on unsupervised graph-based summarization when evaluated both automatically and by humans.
Code (1)
Tasks
Document SummarizationExtractive Document SummarizationExtractive Text SummarizationGraph RankingSentenceSentence EmbeddingSentence-EmbeddingSentence EmbeddingsText SummarizationSimilar Papers 제목 키워드 기반
GUSUM: Graph-Based Unsupervised Summarization using Sentence-BERT and Sentence Features
Unsupervised extractive document summarization aims to extract salient sentences from a document without requiring a labelled corpus. In existing graph-based methods, vertex and edge weights are mostly created by calcula…
Document SummarizationExtractive Document SummarizationExtractive Text SummarizationGraph Ranking+5Bipartite Graph Pre-training for Unsupervised Extractive Summarization with Graph Convolutional Auto-Encoders
Pre-trained sentence representations are crucial for identifying significant sentences in unsupervised document extractive summarization. However, the traditional two-step paradigm of pre-training and sentence-ranking, c…
Extractive SummarizationSentenceSentence EmbeddingsUnsupervised Extractive SummarizationGLIMMER: Incorporating Graph and Lexical Features in Unsupervised Multi-Document Summarization
Pre-trained language models are increasingly being used in multi-document summarization tasks. However, these models need large-scale corpora for pre-training and are domain-dependent. Other non-neural unsupervised summa…
Document SummarizationInformativenessMulti-Document SummarizationSentenceCombining Word Embeddings and N-grams for Unsupervised Document Summarization
Graph-based extractive document summarization relies on the quality of the sentence similarity graph. Bag-of-words or tf-idf based sentence similarity uses exact word matching, but fails to measure the semantic similarit…
DiversityDocument SummarizationExtractive Document SummarizationExtractive Summarization+8Centrality Meets Centroid: A Graph-based Approach for Unsupervised Document Summarization
Unsupervised document summarization has re-acquired lots of attention in recent years thanks to its simplicity and data independence. In this paper, we propose a graph-based unsupervised approach for extractive document …
Document SummarizationExtractive Document SummarizationSentence