Exploiting Discourse-Level Segmentation for Extractive Summarization
Extractive summarization selects and concatenates the most essential text spans in a document. Most, if not all, neural approaches use sentences as the elementary unit to select content for summarization. However, semantic segments containing supplementary information or descriptive details are often nonessential in the generated summaries. In this work, we propose to exploit discourse-level segmentation as a finer-grained means to more precisely pinpoint the core content in a document. We investigate how the sub-sentential segmentation improves extractive summarization performance when content selection is modeled through two basic neural network architectures and a deep bi-directional transformer. Experiment results on the CNN/Daily Mail dataset show that discourse-level segmentation is effective in both cases. In particular, we achieve state-of-the-art performance when discourse-level segmentation is combined with our adapted contextual representation model.
Code (0)
등록된 구현이 없습니다.
Tasks
DescriptiveExtractive SummarizationSegmentationSimilar Papers 제목 키워드 기반
Leveraging Discourse Structure for Extractive Meeting Summarization
We introduce an extractive summarization system for meetings that leverages discourse structure to better identify salient information from complex multi-party discussions. Using discourse graphs to represent semantic re…
Extractive SummarizationMeeting SummarizationNode ClassificationExtractive Summarization Considering Discourse and Coreference Relations based on Heterogeneous Graph
Modeling the relations between text spans in a document is a crucial yet challenging problem for extractive summarization. Various kinds of relations exist among text spans of different granularity, such as discourse rel…
Extractive SummarizationGoSum: Extractive Summarization of Long Documents by Reinforcement Learning and Graph Organized discourse state
Extracting summaries from long documents can be regarded as sentence classification using the structural information of the documents. How to use such structural information to summarize a document is challenging. In thi…
ArticlesDocument SummarizationExtractive Document SummarizationExtractive Summarization+6Do We Really Need That Many Parameters In Transformer For Extractive Summarization? Discourse Can Help !
The multi-head self-attention of popular transformer models is widely used within Natural Language Processing (NLP), including for the task of extractive summarization. With the goal of analyzing and pruning the paramete…
Extractive SummarizationSentenceDiscourse-Aware Neural Extractive Text Summarization
Recently BERT has been adopted for document encoding in state-of-the-art text summarization models. However, sentence-based extractive models often result in redundant or uninformative phrases in the extracted summaries.…
Extractive Text SummarizationSentenceText Summarization