paper-with-me

홈 › Papers

Mix-and-Match: Scalable Dialog Response Retrieval using Gaussian Mixture Embeddings

2022-04-06 · Gaurav Pandey, Danish Contractor, Sachindra Joshi

Embedding-based approaches for dialog response retrieval embed the context-response pairs as points in the embedding space. These approaches are scalable, but fail to account for the complex, many-to-many relationships that exist between context-response pairs. On the other end of the spectrum, there are approaches that feed the context-response pairs jointly through multiple layers of neural networks. These approaches can model the complex relationships between context-response pairs, but fail to scale when the set of responses is moderately large (>100). In this paper, we combine the best of both worlds by proposing a scalable model that can learn complex relationships between context-response pairs. Specifically, the model maps the contexts as well as responses to probability distributions over the embedding space. We train the models by optimizing the Kullback-Leibler divergence between the distributions induced by context-response pairs in the training data. We show that the resultant model achieves better performance as compared to other embedding-based approaches on publicly available conversation data.

📄 PDF Abstract BibTeX arXiv:2204.02710

Code (0)

등록된 구현이 없습니다.

Tasks

Retrieval

Similar Papers 제목 키워드 기반

A Pre-training Strategy for Zero-Resource Response Selection in Knowledge-Grounded Conversations

2021-08-01 · ACL 2021 5 · Chongyang Tao, Changyu Chen, Jiazhan Feng, Ji-Rong Wen 외

Recently, many studies are emerging towards building a retrieval-based dialogue system that is able to effectively leverage background knowledge (e.g., documents) when conversing with humans. However, it is non-trivial t…

Language ModellingRetrievalTask 2

Learning an Effective Context-Response Matching Model with Self-Supervised Tasks for Retrieval-based Dialogues

2020-09-14 · Ruijian Xu, Chongyang Tao, Daxin Jiang, Xueliang Zhao 외

Building an intelligent dialogue system with the ability to select a proper response according to a multi-turn context is a great challenging task. Existing studies focus on building a context-response matching model wit…

Conversational Response SelectionRetrieval

Retrieval-guided Dialogue Response Generation via a Matching-to-Generation Framework

2019-11-01 · IJCNLP 2019 11 · Deng Cai, Yan Wang, Wei Bi, Zhaopeng Tu 외

End-to-end sequence generation is a popular technique for developing open domain dialogue systems, though they suffer from the \textit{safe response problem}. Researchers have attempted to tackle this problem by incorpor…

Response GenerationRetrieval

On the Calibration and Uncertainty with Pólya-Gamma Augmentation for Dialog Retrieval Models

2023-03-15 · Tong Ye, Shijing Si, Jianzong Wang, Ning Cheng 외

Deep neural retrieval models have amply demonstrated their power but estimating the reliability of their predictions remains challenging. Most dialog response retrieval models output a single score for a response on how …

Retrieval

Self-attention Comparison Module for Boosting Performance on Retrieval-based Open-Domain Dialog Systems

2020-12-21 · Tian Lan, Xian-Ling Mao, Zhipeng Zhao, Wei Wei 외

Since the pre-trained language models are widely used, retrieval-based open-domain dialog systems, have attracted considerable attention from researchers recently. Most of the previous works select a suitable response on…

Open-Domain DialogRetrieval