Diversifying Neural Conversation Model with Maximal Marginal Relevance
Neural conversation systems, typically using sequence-to-sequence (seq2seq) models, are showing promising progress recently. However, traditional seq2seq suffer from a severe weakness: during beam search decoding, they tend to rank universal replies at the top of the candidate list, resulting in the lack of diversity among candidate replies. Maximum Marginal Relevance (MMR) is a ranking algorithm that has been widely used for subset selection. In this paper, we propose the MMR-BS decoding method, which incorporates MMR into the beam search (BS) process of seq2seq. The MMR-BS method improves the diversity of generated replies without sacrificing their high relevance with the user-issued query. Experiments show that our proposed model achieves the best performance among other comparison methods.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversityDocument SummarizationInformation RetrievalmodelText CategorizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Generalized People Diversity: Learning a Human Perception-Aligned Diversity Representation for People Images
Capturing the diversity of people in images is challenging: recent literature tends to focus on diversifying one or two attributes, requiring expensive attribute labels or building classifiers. We introduce a diverse peo…
AttributeDiversityUnsupervised Broadcast News Summarization; a comparative study on Maximal Marginal Relevance (MMR) and Latent Semantic Analysis (LSA)
The methods of automatic speech summarization are classified into two groups: supervised and unsupervised methods. Supervised methods are based on a set of features, while unsupervised methods perform summarization based…
News SummarizationDiversifying Reply Suggestions using a Matching-Conditional Variational Autoencoder
We consider the problem of diversifying automated reply suggestions for a commercial instant-messaging (IM) system (Skype). Our conversation model is a standard matching based information retrieval architecture, which co…
DiversityInformation RetrievalRetrievalVariational InferenceDiversifying Dialogue Generation with Non-Conversational Text
Neural network-based sequence-to-sequence (seq2seq) models strongly suffer from the low-diversity problem when it comes to open-domain dialogue generation. As bland and generic utterances usually dominate the frequency d…
Dialogue GenerationDiversityTranslationCombining State-of-the-Art Models with Maximal Marginal Relevance for Few-Shot and Zero-Shot Multi-Document Summarization
In Natural Language Processing, multi-document summarization (MDS) poses many challenges to researchers above those posed by single-document summarization (SDS). These challenges include the increased search space and gr…
DiversityDocument SummarizationMulti-Document Summarization