Analyzing and Learning from User Interactions for Search Clarification
Asking clarifying questions in response to search queries has been recognized as a useful technique for revealing the underlying intent of the query. Clarification has applications in retrieval systems with different interfaces, from the traditional web search interfaces to the limited bandwidth interfaces as in speech-only and small screen devices. Generation and evaluation of clarifying questions have been recently studied in the literature. However, user interaction with clarifying questions is relatively unexplored. In this paper, we conduct a comprehensive study by analyzing large-scale user interactions with clarifying questions in a major web search engine. In more detail, we analyze the user engagements received by clarifying questions based on different properties of search queries, clarifying questions, and their candidate answers. We further study click bias in the data, and show that even though reading clarifying questions and candidate answers does not take significant efforts, there still exist some position and presentation biases in the data. We also propose a model for learning representation for clarifying questions based on the user interaction data as implicit feedback. The model is used for re-ranking a number of automatically generated clarifying questions for a given query. Evaluation on both click data and human labeled data demonstrates the high quality of the proposed method.
Code (0)
등록된 구현이 없습니다.
Tasks
Re-RankingRetrievalSimilar Papers 제목 키워드 기반
MIMICS: A Large-Scale Data Collection for Search Clarification
Search clarification has recently attracted much attention due to its applications in search engines. It has also been recognized as a major component in conversational information seeking systems. Despite its importance…
2kInteractive Query Clarification and Refinement via User Simulation
When users initiate search sessions, their queries are often unclear or might lack of context; this resulting in inefficient document ranking. Multiple approaches have been proposed by the Information Retrieval community…
Document RankingInformation RetrievalRetrievalUser SimulationCIRCLE: Multi-Turn Query Clarifications with Reinforcement Learning
Users often have trouble formulating their information needs into words on the first try when searching online. This can lead to frustration, as they may have to reformulate their queries when retrieved information is no…
Language ModelingLanguage Modellingreinforcement-learningReinforcement Learning+1Analysing Mixed Initiatives and Search Strategies during Conversational Search
Information seeking conversations between users and Conversational Search Agents (CSAs) consist of multiple turns of interaction. While users initiate a search session, ideally a CSA should sometimes take the lead in the…
Conversational SearchMulti-Turn Multi-Modal Question Clarification for Enhanced Conversational Understanding
Conversational query clarification enables users to refine their search queries through interactive dialogue, improving search effectiveness. Traditional approaches rely on text-based clarifying questions, which often fa…
Re-RankingRetrieval