Multi-Document Summarization withDeterminantal Point Process Attention
The ability to convey relevant and diverse information is critical in multi-documentsummarization and yet remains elusive for neural seq-to-seq models whose outputs are of-ten redundant and fail to correctly cover important details. In this work, we propose anattention mechanism which encourages greater focus onrelevanceanddiversity. Attentionweights are computed based on (proportional) probabilities given by Determinantal PointProcesses (DPPs) defined on the set of content units to be summarized. DPPs have beensuccessfully used in extractive summarisation, here we use them to select relevant anddiverse content for neural abstractive summarisation. We integrate DPP-based attentionwith various seq-to-seq architectures ranging from CNNs to LSTMs, and Transformers.Experimental evaluation shows that our attention mechanism consistently improves sum-marization and delivers performance comparable with the state-of-the-art on the MultiNewsdataset.
Code (0)
등록된 구현이 없습니다.
Tasks
Document SummarizationMulti-Document SummarizationSimilar Papers 제목 키워드 기반
Improving the Similarity Measure of Determinantal Point Processes for Extractive Multi-Document Summarization
The most important obstacles facing multi-document summarization include excessive redundancy in source descriptions and the looming shortage of training data. These obstacles prevent encoder-decoder models from being us…
DecoderDocument SummarizationMulti-Document SummarizationPoint ProcessesA Novel LLM-based Two-stage Summarization Approach for Long Dialogues
Long document summarization poses a significant challenge in natural language processing due to input lengths that exceed the capacity of most state-of-the-art pre-trained language models. This study proposes a hierarchi…
Abstractive Text SummarizationDocument SummarizationNeural Abstractive Summarization with Structural Attention
Attentional, RNN-based encoder-decoder architectures have achieved impressive performance on abstractive summarization of news articles. However, these methods fail to account for long term dependencies within the senten…
Abstractive Text SummarizationArticlesCommunity Question AnsweringDecoder+4Shaping Political Discourse using multi-source News Summarization
Multi-document summarization is the process of automatically generating a concise summary of multiple documents related to the same topic. This summary can help users quickly understand the key information from a large c…
Document SummarizationMulti-Document SummarizationNews SummarizationTopic-Guided Abstractive Multi-Document Summarization
A critical point of multi-document summarization (MDS) is to learn the relations among various documents. In this paper, we propose a novel abstractive MDS model, in which we represent multiple documents as a heterogeneo…
Document SummarizationGraph-to-SequenceMulti-Document SummarizationMulti-Task Learning