A Repository of Conversational Datasets
Progress in Machine Learning is often driven by the availability of large datasets, and consistent evaluation metrics for comparing modeling approaches. To this end, we present a repository of conversational datasets consisting of hundreds of millions of examples, and a standardised evaluation procedure for conversational response selection models using '1-of-100 accuracy'. The repository contains scripts that allow researchers to reproduce the standard datasets, or to adapt the pre-processing and data filtering steps to their needs. We introduce and evaluate several competitive baselines for conversational response selection, whose implementations are shared in the repository, as well as a neural encoder model that is trained on the entire training set.
Code (3)
Tasks
BIG-bench Machine LearningConversational Response SelectionDialogue UnderstandingSimilar Papers 제목 키워드 기반
MConv: An Environment for Multimodal Conversational Search across Multiple Domains
Although conversational search has become a hot topic in both dialogue research and IR community, the real breakthrough has been limited by the scale and quality of datasets available. To address this fundamental obstacl…
Conversational RecommendationConversational SearchDialogue State TrackingResponse GenerationComprehensive Comparison of RAG Methods Across Multi-Domain Conversational QA
Conversational question answering increasingly relies on retrieval-augmented generation (RAG) to ground large language models (LLMs) in external knowledge. Yet, most existing studies evaluate RAG methods in isolation and…
Conversational Question AnsweringAnswer GenerationQuestion rewriting? Assessing its importance for conversational question answering
In conversational question answering, systems must correctly interpret the interconnected interactions and generate knowledgeable answers, which may require the retrieval of relevant information from a background reposit…
Conversational Question AnsweringQuestion AnsweringQuestion RewritingRetrievalLogicLens: Leveraging Semantic Code Graph to explore Multi Repository large systems
Understanding large software systems is a challenging task, especially when code is distributed across multiple repositories and microservices. Developers often need to reason not only about the structure of the code, bu…
Federated Conversational Recommender System
Conversational Recommender Systems (CRSs) have become increasingly popular as a powerful tool for providing personalized recommendation experiences. By directly engaging with users in a conversational manner to learn the…
Conversational RecommendationRecommendation Systems