Improving the Similarity Measure of Determinantal Point Processes for Extractive Multi-Document Summarization
The most important obstacles facing multi-document summarization include excessive redundancy in source descriptions and the looming shortage of training data. These obstacles prevent encoder-decoder models from being used directly, but optimization-based methods such as determinantal point processes (DPPs) are known to handle them well. In this paper we seek to strengthen a DPP-based method for extractive multi-document summarization by presenting a novel similarity measure inspired by capsule networks. The approach measures redundancy between a pair of sentences based on surface form and semantic information. We show that our DPP system with improved similarity measure performs competitively, outperforming strong summarization baselines on benchmark datasets. Our findings are particularly meaningful for summarizing documents created by multiple authors containing redundant yet lexically diverse expressions.
Code (1)
Tasks
DecoderDocument SummarizationMulti-Document SummarizationPoint ProcessesSimilar Papers 제목 키워드 기반
Multi-Document Summarization with Determinantal Point Processes and Contextualized Representations
Emerged as one of the best performing techniques for extractive summarization, determinantal point processes select the most probable set of sentences to form a summary according to a probability measure defined by model…
Document SummarizationExtractive SummarizationMulti-Document SummarizationPoint Processes+1Fast Sampling for Strongly Rayleigh Measures with Application to Determinantal Point Processes
In this note we consider sampling from (non-homogeneous) strongly Rayleigh probability measures. As an important corollary, we obtain a fast mixing Markov Chain sampler for Determinantal Point Processes.
Point ProcessesExtractive Financial Narrative Summarisation based on DPPs
We participate in the FNS-Summarisation 2020 shared task to be held at FNP 2020 workshop at COLING 2020. Based on Determinantal Point Processes (DPPs), we build an extractive automatic financial summarisation system for …
DiversityPoint ProcessesA novel sampler for Gauss-Hermite determinantal point processes with application to Monte Carlo integration
Determinantal points processes are a promising but relatively under-developed tool in machine learning and statistical modelling, being the canonical statistical example of distributions with repulsion. While their mathe…
BIG-bench Machine LearningPoint ProcessesMulti-Document Summarization withDeterminantal Point Process Attention
The ability to convey relevant and diverse information is critical in multi-documentsummarization and yet remains elusive for neural seq-to-seq models whose outputs are of-ten redundant and fail to correctly c…
Document SummarizationMulti-Document Summarization