Combining State-of-the-Art Models with Maximal Marginal Relevance for Few-Shot and Zero-Shot Multi-Document Summarization
In Natural Language Processing, multi-document summarization (MDS) poses many challenges to researchers above those posed by single-document summarization (SDS). These challenges include the increased search space and greater potential for the inclusion of redundant information. While advancements in deep learning approaches have led to the development of several advanced language models capable of summarization, the variety of training data specific to the problem of MDS remains relatively limited. Therefore, MDS approaches which require little to no pretraining, known as few-shot or zero-shot applications, respectively, could be beneficial additions to the current set of tools available in summarization. To explore one possible approach, we devise a strategy for combining state-of-the-art models' outputs using maximal marginal relevance (MMR) with a focus on query relevance rather than document diversity. Our MMR-based approach shows improvement over some aspects of the current state-of-the-art results in both few-shot and zero-shot MDS applications while maintaining a state-of-the-art standard of output by all available metrics.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversityDocument SummarizationMulti-Document SummarizationSimilar Papers 제목 키워드 기반
Unsupervised Broadcast News Summarization; a comparative study on Maximal Marginal Relevance (MMR) and Latent Semantic Analysis (LSA)
The methods of automatic speech summarization are classified into two groups: supervised and unsupervised methods. Supervised methods are based on a set of features, while unsupervised methods perform summarization based…
News SummarizationExtractive Multi-document Summarization using K-means, Centroid-based Method, MMR, and Sentence Position
Multi-document summarization is more challenging than single-document summarization since it has to solve the problem of overlapping information among sentences from different documents. Also, since multi-document summar…
ClusteringDocument SummarizationExtractive Text SummarizationMulti-Document Summarization+2Maximizing Marginal Fairness for Dynamic Learning to Rank
Rankings, especially those in search and recommendation systems, often determine how people access information and how information is exposed to people. Therefore, how to balance the relevance and fairness of information…
FairnessLearning-To-RankRecommendation SystemsExtractive Summarization of Legal Decisions using Multi-task Learning and Maximal Marginal Relevance
Summarizing legal decisions requires the expertise of law practitioners, which is both time- and cost-intensive. This paper presents techniques for extractive summarization of legal decisions in a low-resource setting us…
Extractive SummarizationMulti-Task LearningDiversifying Neural Conversation Model with Maximal Marginal Relevance
Neural conversation systems, typically using sequence-to-sequence (seq2seq) models, are showing promising progress recently. However, traditional seq2seq suffer from a severe weakness: during beam search decoding, they t…
DiversityDocument SummarizationInformation Retrievalmodel+1