Unsupervised Text Summarization of Long Documents using Dependency-based Noun Phrases and Contextual Order Arrangement
Unsupervised extractive summarization has recently gained importance since it does not require labeled data. Among unsupervised methods, graph-based approaches have achieved outstanding results. These methods represent each document by a graph, with sentences as nodes and word-level similarity among sentences as edges. Common words can easily lead to a strong connection between sentence nodes. Thus, sentences with many common words can be misinterpreted as salient sentences for a summary. This work addresses the common word issue with a phrase-level graph that (1) focuses on the noun phrases of a document based on grammar dependencies and (2) initializes edge weights by term-frequency within the target document and inverse document frequency over the entire corpus. The importance scores of noun phrases extracted from the graph are then used to select the most salient sentences. To preserve summary coherence, the order of the selected sentences is re-arranged by a flow-aware orderBERT. The results reveal that our unsupervised framework outperformed other extractive methods on ROUGE as well as two human evaluations for semantic similarity and summary coherence.
Code (0)
등록된 구현이 없습니다.
Tasks
Extractive SummarizationSemantic SimilaritySemantic Textual SimilaritySentenceText SummarizationUnsupervised Extractive SummarizationUnsupervised Text SummarizationSimilar Papers 제목 키워드 기반
A Novel LLM-based Two-stage Summarization Approach for Long Dialogues
Long document summarization poses a significant challenge in natural language processing due to input lengths that exceed the capacity of most state-of-the-art pre-trained language models. This study proposes a hierarchi…
Abstractive Text SummarizationDocument SummarizationGenCompareSum: a hybrid unsupervised summarization method using salience
Text summarization (TS) is an important NLP task. Pre-trained Language Models (PLMs) have been used to improve the performance of TS. However, PLMs are limited by their need of labelled training data and by their attenti…
Extractive SummarizationText SummarizationLong Document Summarization with Top-down and Bottom-up Inference
Text summarization aims to condense long documents and retain key information. Critical to the success of a summarization model is the faithful inference of latent representations of words or tokens in the source documen…
Text SummarizationLong Document Summarization with Top-Down and Bottom-Up Representation Inference
Text summarization aims to condense long documents and retain key information. Critical to the success of a summarization model is the faithful inference of latent representations of words or tokens in the source documen…
Document SummarizationText SummarizationHEGEL: Hypergraph Transformer for Long Document Summarization
Extractive summarization for long documents is challenging due to the extended structured input context. The long-distance sentence dependency hinders cross-sentence relations modeling, the critical step of extractive su…
Document SummarizationExtractive SummarizationSentence