Estimating the Usefulness of Clarifying Questions and Answers for Conversational Search
While the body of research directed towards constructing and generating clarifying questions in mixed-initiative conversational search systems is vast, research aimed at processing and comprehending users' answers to such questions is scarce. To this end, we present a simple yet effective method for processing answers to clarifying questions, moving away from previous work that simply appends answers to the original query and thus potentially degrades retrieval performance. Specifically, we propose a classifier for assessing usefulness of the prompted clarifying question and an answer given by the user. Useful questions or answers are further appended to the conversation history and passed to a transformer-based query rewriting module. Results demonstrate significant improvements over strong non-mixed-initiative baselines. Furthermore, the proposed approach mitigates the performance drops when non useful questions and answers are utilized.
Code (0)
등록된 구현이 없습니다.
Tasks
Conversational SearchRetrievalMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Analysing the Effect of Clarifying Questions on Document Ranking in Conversational Search
Recent research on conversational search highlights the importance of mixed-initiative in conversations. To enable mixed-initiative, the system should be able to ask clarifying questions to the user. However, the ability…
Conversational SearchDocument RankingEvaluating Mixed-initiative Conversational Search Systems via User Simulation
Clarifying the underlying user information need by asking clarifying questions is an important feature of modern conversational search system. However, evaluation of such systems through answering prompted clarifying que…
Conversational SearchText GenerationUser SimulationDo Images Clarify? A Study on the Effect of Images on Clarifying Questions in Conversational Search
Conversational search systems increasingly employ clarifying questions to refine user queries and improve the search experience. Previous studies have demonstrated the usefulness of text-based clarifying questions in enh…
Question AnsweringAsking Clarifying Questions for Preference Elicitation With Large Language Models
Large Language Models (LLMs) have made it possible for recommendation systems to interact with users in open-ended conversational interfaces. In order to personalize LLM responses, it is crucial to elicit user preference…
Recommendation SystemsAGENT-CQ: Automatic Generation and Evaluation of Clarifying Questions for Conversational Search with LLMs
Generating diverse and effective clarifying questions is crucial for improving query understanding and retrieval performance in open-domain conversational search (CS) systems. We propose AGENT-CQ (Automatic GENeration, a…
Conversational SearchRetrieval