Discriminative Marginalized Probabilistic Neural Method for Multi-Document Summarization of Medical Literature
Although current state-of-the-art Transformer-based solutions succeeded in a wide range for single-document NLP tasks, they still struggle to address multi-input tasks such as multi-document summarization. Many solutions truncate the inputs, thus ignoring potential summary-relevant contents, which is unacceptable in the medical domain where each information can be vital. Others leverage linear model approximations to apply multi-input concatenation, worsening the results because all information is considered, even if it is conflicting or noisy with respect to a shared background. Despite the importance and social impact of medicine, there are no ad-hoc solutions for multi-document summarization. For this reason, we propose a novel discriminative marginalized probabilistic method (DAMEN) trained to discriminate critical information from a cluster of topic-related medical documents and generate a multi-document summary via token probability marginalization. Results prove we outperform the previous state-of-the-art on a biomedical dataset for multi-document summarization of systematic literature reviews. Moreover, we perform extensive ablation studies to motivate the design choices and prove the importance of each module of our method.
Code (0)
등록된 구현이 없습니다.
Tasks
Document SummarizationMulti-Document SummarizationSimilar Papers 제목 키워드 기반
Multi-Document Summarization via Discriminative Summary Reranking
Existing multi-document summarization systems usually rely on a specific summarization model (i.e., a summarization method with a specific parameter setting) to extract summaries for different document sets with differen…
Document SummarizationMulti-Document SummarizationRerankingSentenceExploring Differential Topic Models for Comparative Summarization of Scientific Papers
This paper investigates differential topic models (dTM) for summarizing the differences among document groups. Starting from a simple probabilistic generative model, we propose dTM-SAGE that explicitly models the deviati…
SentenceSentiment AnalysisTopic ModelsVideo Summarization using Denoising Diffusion Probabilistic Model
Video summarization aims to eliminate visual redundancy while retaining key parts of video to construct concise and comprehensive synopses. Most existing methods use discriminative models to predict the importance scores…
DenoisingmodelUnsupervised Video SummarizationVideo SummarizationMarginalized Average Attentional Network for Weakly-Supervised Learning
In weakly-supervised temporal action localization, previous works have failed to locate dense and integral regions for each entire action due to the overestimation of the most salient regions. To alleviate this issue, we…
Action LocalizationTemporal Action LocalizationWeakly Supervised Action LocalizationWeakly-supervised Learning+1Abstractive Multi-Document Summarization via Joint Learning with Single-Document Summarization
Single-document and multi-document summarizations are very closely related in both task definition and solution method. In this work, we propose to improve neural abstractive multi-document summarization by jointly learn…
DecoderDocument SummarizationMulti-Document Summarization