GUSUM: Graph-Based Unsupervised Summarization using Sentence-BERT and Sentence Features
Unsupervised extractive document summarization aims to extract salient sentences from a document without requiring a labelled corpus. In existing graph-based methods, vertex and edge weights are mostly created by calculating sentence similarities. In this paper, we develop a Graph-Based Unsupervised Summarization method for extractive text summarization. We revive traditional graph ranking algorithms with recent sentence embedding models and sentence features and modify how sentence centrality is computed. We first use Sentence-BERT, a state-of-the-art method for obtaining sentence embeddings to better capture the sentence meaning. In this way, we define the edges of a graph where semantic similarities are represented. Then, we create an undirected graph in which the calculated sentence feature scores of each sentence are represented in the vertices. In the last stage, we determine the most important sentences in the document with the ranking method we suggested on the graph created. Experiments on CNN/Daily Mail and New York Times datasets show our approach achieves high performance on unsupervised graph-based summarization when evaluated both automatically and by humans.
Code (0)
등록된 구현이 없습니다.
Tasks
Document SummarizationExtractive Document SummarizationExtractive Text SummarizationGraph RankingSentenceSentence EmbeddingSentence-EmbeddingSentence EmbeddingsText SummarizationSimilar Papers 제목 키워드 기반
GUSUM: Graph-based Unsupervised Summarization Using Sentence Features Scoring and Sentence-BERT
Unsupervised extractive document summarization aims to extract salient sentences from a document without requiring a labelled corpus. In existing graph-based methods, vertex and edge weights are usually created by calcul…
Document SummarizationExtractive Document SummarizationExtractive Text SummarizationGraph Ranking+5Bipartite Graph Pre-training for Unsupervised Extractive Summarization with Graph Convolutional Auto-Encoders
Pre-trained sentence representations are crucial for identifying significant sentences in unsupervised document extractive summarization. However, the traditional two-step paradigm of pre-training and sentence-ranking, c…
Extractive SummarizationSentenceSentence EmbeddingsUnsupervised Extractive SummarizationSciSummPip: An Unsupervised Scientific Paper Summarization Pipeline
The Scholarly Document Processing (SDP) workshop is to encourage more efforts on natural language understanding of scientific task. It contains three shared tasks and we participate in the LongSumm shared task. In this p…
ClusteringGraph Clusteringgraph constructionLanguage Modeling+5Monash-Summ@LongSumm 20 SciSummPip: An Unsupervised Scientific Paper Summarization Pipeline
The Scholarly Document Processing (SDP) workshop is to encourage more efforts on natural language understanding of scientific task. It contains three shared tasks and we participate in the LongSumm shared task. In this p…
Graph Clusteringgraph constructionLanguage ModelingLanguage Modelling+4Unsupervised Text Summarization of Long Documents using Dependency-based Noun Phrases and Contextual Order Arrangement
Unsupervised extractive summarization has recently gained importance since it does not require labeled data. Among unsupervised methods, graph-based approaches have achieved outstanding results. These methods represent e…
Extractive SummarizationSemantic SimilaritySemantic Textual SimilaritySentence+3