Asking Clarifying Questions Based on Negative Feedback in Conversational Search
Users often need to look through multiple search result pages or reformulate queries when they have complex information-seeking needs. Conversational search systems make it possible to improve user satisfaction by asking questions to clarify users' search intents. This, however, can take significant effort to answer a series of questions starting with "what/why/how". To quickly identify user intent and reduce effort during interactions, we propose an intent clarification task based on yes/no questions where the system needs to ask the correct question about intents within the fewest conversation turns. In this task, it is essential to use negative feedback about the previous questions in the conversation history. To this end, we propose a Maximum-Marginal-Relevance (MMR) based BERT model (MMR-BERT) to leverage negative feedback based on the MMR principle for the next clarifying question selection. Experiments on the Qulac dataset show that MMR-BERT outperforms state-of-the-art baselines significantly on the intent identification task and the selected questions also achieve significantly better performance in the associated document retrieval tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Conversational SearchQuestion SelectionRetrievalMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Simulating and Modeling the Risk of Conversational Search
In conversational search, agents can interact with users by asking clarifying questions to increase their chance to find better results. Many recent works and shared tasks in both NLP and IR communities have focused on i…
Conversational SearchDeciding Whether to Ask Clarifying Questions in Large-Scale Spoken Language Understanding
A large-scale conversational agent can suffer from understanding user utterances with various ambiguities such as ASR ambiguity, intent ambiguity, and hypothesis ambiguity. When ambiguities are detected, the agent should…
Spoken Language UnderstandingAsking Multimodal Clarifying Questions in Mixed-Initiative Conversational Search
In mixed-initiative conversational search systems, clarifying questions are used to help users who struggle to express their intentions in a single query. These questions aim to uncover user's information needs and resol…
4kConversational SearchGuided Transformer: Leveraging Multiple External Sources for Representation Learning in Conversational Search
Asking clarifying questions in response to ambiguous or faceted queries has been recognized as a useful technique for various information retrieval systems, especially conversational search systems with limited bandwidth…
Conversational SearchInformation RetrievalQuestion SelectionRepresentation Learning+1Controlling the Risk of Conversational Search via Reinforcement Learning
Users often formulate their search queries with immature language without well-developed keywords and complete structures. Such queries fail to express their true information needs and raise ambiguity as fragmental langu…
Conversational Searchreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1