Multi-stage Clarification in Conversational AI: The case of Question-Answering Dialogue Systems
Clarification resolution plays an important role in various information retrieval tasks such as interactive question answering and conversational search. In such context, the user often formulates their information needs as short and ambiguous queries, some popular search interfaces then prompt the user to confirm her intent (e.g. "Did you mean ... ?") or to rephrase if needed. When it comes to dialogue systems, having fluid user-bot exchanges is key to good user experience. In the absence of such clarification mechanism, one of the following responses is given to the user: 1) A direct answer, which can potentially be non-relevant if the intent was not clear, 2) a generic fallback message informing the user that the retrieval tool is incapable of handling the query. Both scenarios might raise frustration and degrade the user experience. To this end, we propose a multi-stage clarification mechanism for prompting clarification and query selection in the context of a question answering dialogue system. We show that our proposed mechanism improves the overall user experience and outperforms competitive baselines with two datasets, namely the public in-scope out-of-scope dataset and a commercial dataset based on real user logs.
Code (0)
등록된 구현이 없습니다.
Tasks
Conversational SearchInformation RetrievalQuestion AnsweringRetrievalSimilar Papers 제목 키워드 기반
Conversational Search with Mixed-Initiative - Asking Good Clarification Questions backed-up by Passage Retrieval
We deal with the scenario of conversational search, where user queries are under-specified or ambiguous. This calls for a mixed-initiative setup. User-asks (queries) and system-answers, as well as system-asks (clarificat…
Conversational SearchPassage RetrievalRetrievalConversational Search with Mixed-Initiative -- Asking Good Clarification Questions backed-up by Passage Retrieval
We deal with the scenario of conversational search, where user queries are under-specified or ambiguous. This calls for a mixed-initiative setup. User-asks (queries) and system-answers, as well as system-asks (clarificat…
Conversational SearchPassage RetrievalRe-RankingRetrievalAsking Multimodal Clarifying Questions in Mixed-Initiative Conversational Search
In mixed-initiative conversational search systems, clarifying questions are used to help users who struggle to express their intentions in a single query. These questions aim to uncover user's information needs and resol…
4kConversational SearchA Clarifying Question Selection System from NTES_ALONG in Convai3 Challenge
This paper presents the participation of NetEase Game AI Lab team for the ClariQ challenge at Search-oriented Conversational AI (SCAI) EMNLP workshop in 2020. The challenge asks for a complete conversational information …
Information RetrievalQuestion SelectionRetrievalICR: Iterative Clarification and Rewriting for Conversational Search
Most previous work on Conversational Query Rewriting employs an end-to-end rewriting paradigm. However, this approach is hindered by the issue of multiple fuzzy expressions within the query, which complicates the simulta…