paper-with-me

홈 › Papers

A Survey on Asking Clarification Questions Datasets in Conversational Systems

2023-05-25 · Hossein A. Rahmani, Xi Wang, Yue Feng, Qiang Zhang, Emine Yilmaz, Aldo Lipani

The ability to understand a user's underlying needs is critical for conversational systems, especially with limited input from users in a conversation. Thus, in such a domain, Asking Clarification Questions (ACQs) to reveal users' true intent from their queries or utterances arise as an essential task. However, it is noticeable that a key limitation of the existing ACQs studies is their incomparability, from inconsistent use of data, distinct experimental setups and evaluation strategies. Therefore, in this paper, to assist the development of ACQs techniques, we comprehensively analyse the current ACQs research status, which offers a detailed comparison of publicly available datasets, and discusses the applied evaluation metrics, joined with benchmarks for multiple ACQs-related tasks. In particular, given a thorough analysis of the ACQs task, we discuss a number of corresponding research directions for the investigation of ACQs as well as the development of conversational systems.

📄 PDF Abstract BibTeX arXiv:2305.15933

Code (1)

rahmanidashti/acqsurvey 공식 구현

Similar Papers 제목 키워드 기반

Conversational Search with Mixed-Initiative - Asking Good Clarification Questions backed-up by Passage Retrieval

2022-05-01 · dialdoc (ACL) 2022 5 · Yosi Mass, Doron Cohen, Asaf Yehudai, David Konopnicki

We deal with the scenario of conversational search, where user queries are under-specified or ambiguous. This calls for a mixed-initiative setup. User-asks (queries) and system-answers, as well as system-asks (clarificat…

Conversational SearchPassage RetrievalRetrieval

Conversational Search with Mixed-Initiative -- Asking Good Clarification Questions backed-up by Passage Retrieval

2021-12-14 · Yosi Mass, Doron Cohen, Asaf Yehudai, David Konopnicki

We deal with the scenario of conversational search, where user queries are under-specified or ambiguous. This calls for a mixed-initiative setup. User-asks (queries) and system-answers, as well as system-asks (clarificat…

Conversational SearchPassage RetrievalRe-RankingRetrieval

Asking Multimodal Clarifying Questions in Mixed-Initiative Conversational Search

2024-02-12 · Yifei Yuan, Clemencia Siro, Mohammad Aliannejadi, Maarten de Rijke 외

In mixed-initiative conversational search systems, clarifying questions are used to help users who struggle to express their intentions in a single query. These questions aim to uncover user's information needs and resol…

4kConversational Search

ProductAgent: Benchmarking Conversational Product Search Agent with Asking Clarification Questions

2024-07-01 · Jingheng Ye, Yong Jiang, Xiaobin Wang, Yinghui Li 외

This paper introduces the task of product demand clarification within an e-commercial scenario, where the user commences the conversation with ambiguous queries and the task-oriented agent is designed to achieve more acc…

BenchmarkingQuestion GenerationQuestion-GenerationRetrieval

RAC: Retrieval-Augmented Clarification for Faithful Conversational Search

2026-01-16 · Ahmed Rayane Kebir, Vincent Guigue, Lynda Said Lhadj, Laure Soulier arxiv

Clarification questions help conversational search systems resolve ambiguous or underspecified user queries. While prior work has focused on fluency and alignment with user intent, especially through facet extraction, mu…