Avoiding Echo-Responses in a Retrieval-Based Conversation System
Retrieval-based conversation systems generally tend to highly rank responses that are semantically similar or even identical to the given conversation context. While the system's goal is to find the most appropriate response, rather than the most semantically similar one, this tendency results in low-quality responses. We refer to this challenge as the echoing problem. To mitigate this problem, we utilize a hard negative mining approach at the training stage. The evaluation shows that the resulting model reduces echoing and achieves better results in terms of Average Precision and Recall@N metrics, compared to the models trained without the proposed approach.
Code (0)
등록된 구현이 없습니다.
Tasks
RetrievalSimilar Papers 제목 키워드 기반
ECHO: An Open Research Platform for Evaluation of Chat, Human Behavior, and Outcomes
ECHO (Evaluation of Chat, Human behavior, and Outcomes) is an open research platform designed to support reproducible, mixed-method studies of human interaction with both conversational AI systems and Web search engines.…
Information RetrievalDecision MakingA Hybrid Retrieval-Generation Neural Conversation Model
Intelligent personal assistant systems that are able to have multi-turn conversations with human users are becoming increasingly popular. Most previous research has been focused on using either retrieval-based or generat…
DiversitymodelRetrievalText Generation+1Adaptive Retrieval-Augmented Generation for Conversational Systems
Despite the success of integrating large language models into the development of conversational systems, many studies have shown the effectiveness of retrieving and augmenting external knowledge for informative responses…
RAGRetrievalRetrieval-augmented GenerationdEchorate: a Calibrated Room Impulse Response Database for Echo-aware Signal Processing
This paper presents dEchorate: a new database of measured multichannel Room Impulse Responses (RIRs) including annotations of early echo timings and 3D positions of microphones, real sources and image sources under diffe…
BenchmarkingRetrievalRoom Impulse Response (RIR)Speech EnhancementDistilling the Knowledge of Large-scale Generative Models into Retrieval Models for Efficient Open-domain Conversation
Despite the remarkable performance of large-scale generative models in open-domain conversation, they are known to be less practical for building real-time conversation systems due to high latency. On the other hand, ret…
Knowledge DistillationRetrieval