paper-with-me

홈 › Papers

ChatRetriever: Adapting Large Language Models for Generalized and Robust Conversational Dense Retrieval

2024-04-21 · Kelong Mao, Chenlong Deng, Haonan Chen, Fengran Mo, Zheng Liu, Tetsuya Sakai, Zhicheng Dou

Conversational search requires accurate interpretation of user intent from complex multi-turn contexts. This paper presents ChatRetriever, which inherits the strong generalization capability of large language models to robustly represent complex conversational sessions for dense retrieval. To achieve this, we propose a simple and effective dual-learning approach that adapts LLM for retrieval via contrastive learning while enhancing the complex session understanding through masked instruction tuning on high-quality conversational instruction tuning data. Extensive experiments on five conversational search benchmarks demonstrate that ChatRetriever substantially outperforms existing conversational dense retrievers, achieving state-of-the-art performance on par with LLM-based rewriting approaches. Furthermore, ChatRetriever exhibits superior robustness in handling diverse conversational contexts. Our work highlights the potential of adapting LLMs for retrieval with complex inputs like conversational search sessions and proposes an effective approach to advance this research direction.

📄 PDF Abstract BibTeX arXiv:2404.13556

Code (1)

kyriemao/chatretriever 공식 구현 pytorch

Tasks

Contrastive LearningConversational SearchRetrieval

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Cross-Lingual Conversational Speech Summarization with Large Language Models

2024-08-12 · Max Nelson, Shannon Wotherspoon, Francis Keith, William Hartmann 외

Cross-lingual conversational speech summarization is an important problem, but suffers from a dearth of resources. While transcriptions exist for a number of languages, translated conversational speech is rare and datase…

Machine Translationspeech-recognitionSpeech RecognitionTranslation

Human-1 by Josh Talks: A Full-Duplex Conversational Modeling Framework in Hindi using Real-World Conversations

2026-04-25 · Bhaskar Singh, Shobhit Banga, Mahima Manik, Pranav Sharma arxiv

Full-duplex spoken dialogue systems can model natural conversational behaviours such as interruptions, overlaps, and backchannels, yet such systems remain largely unexplored for Indian languages. We present the first ope…

Text Generation

Curriculum-Driven Edubot: A Framework for Developing Language Learning Chatbots Through Synthesizing Conversational Data

2023-09-28 · Yu Li, Shang Qu, Jili Shen, Shangchao Min 외

Chatbots have become popular in educational settings, revolutionizing how students interact with material and how teachers teach. We present Curriculum-Driven EduBot, a framework for developing a chatbot that combines th…

Chatbot

RaDialog: A Large Vision-Language Model for Radiology Report Generation and Conversational Assistance

2023-11-30 · Chantal Pellegrini, Ege Özsoy, Benjamin Busam, Nassir Navab 외

Conversational AI tools that can generate and discuss clinically correct radiology reports for a given medical image have the potential to transform radiology. Such a human-in-the-loop radiology assistant could facilitat…

DiagnosticLanguage ModelingLanguage ModellingLarge Language Model+1

Personality-aware Student Simulation for Conversational Intelligent Tutoring Systems

2024-04-10 · Zhengyuan Liu, Stella Xin Yin, Geyu Lin, Nancy F. Chen

Intelligent Tutoring Systems (ITSs) can provide personalized and self-paced learning experience. The emergence of large language models (LLMs) further enables better human-machine interaction, and facilitates the develop…

Math