Enhancing Conversational Search: Large Language Model-Aided Informative Query Rewriting
Query rewriting plays a vital role in enhancing conversational search by transforming context-dependent user queries into standalone forms. Existing approaches primarily leverage human-rewritten queries as labels to train query rewriting models. However, human rewrites may lack sufficient information for optimal retrieval performance. To overcome this limitation, we propose utilizing large language models (LLMs) as query rewriters, enabling the generation of informative query rewrites through well-designed instructions. We define four essential properties for well-formed rewrites and incorporate all of them into the instruction. In addition, we introduce the role of rewrite editors for LLMs when initial query rewrites are available, forming a "rewrite-then-edit" process. Furthermore, we propose distilling the rewriting capabilities of LLMs into smaller models to reduce rewriting latency. Our experimental evaluation on the QReCC dataset demonstrates that informative query rewrites can yield substantially improved retrieval performance compared to human rewrites, especially with sparse retrievers.
Code (1)
Tasks
Conversational SearchLanguage ModelingLanguage ModellingLarge Language ModelRetrievalSimilar Papers 제목 키워드 기반
ChatRetriever: Adapting Large Language Models for Generalized and Robust Conversational Dense Retrieval
Conversational search requires accurate interpretation of user intent from complex multi-turn contexts. This paper presents ChatRetriever, which inherits the strong generalization capability of large language models to r…
Contrastive LearningConversational SearchRetrievalA Survey of Conversational Search
As a cornerstone of modern information access, search engines have become indispensable in everyday life. With the rapid advancements in AI and natural language processing (NLP) technologies, particularly large language …
Conversational SearchInformation RetrievalResponse GenerationRetrieval+1Chit-Chat or Deep Talk: Prompt Engineering for Process Mining
This research investigates the application of Large Language Models (LLMs) to augment conversational agents in process mining, aiming to tackle its inherent complexity and diverse skill requirements. While LLM advancemen…
Prompt EngineeringTowards Enhancing Linked Data Retrieval in Conversational UIs using Large Language Models
Despite the recent broad adoption of Large Language Models (LLMs) across various domains, their potential for enriching information systems in extracting and exploring Linked Data (LD) and Resource Description Framework …
Natural Language UnderstandingRetrievalLet’s Write Privacy: Survey and Experiment Design on Textual Privacy in Conversation
This research article emphasizes the significance of privacy in textual conversational data, specifically in the context of interactions between virtual assistants and users. While previous studies have primarily focused…