paper-with-me

Papers

Zero-shot Clarifying Question Generation for Conversational Search

2023-01-30 · Zhenduo Wang, Yuancheng Tu, Corby Rosset, Nick Craswell, Ming Wu, Qingyao Ai

A long-standing challenge for search and conversational assistants is query intention detection in ambiguous queries. Asking clarifying questions in conversational search has been widely studied and considered an effective solution to resolve query ambiguity. Existing work have explored various approaches for clarifying question ranking and generation. However, due to the lack of real conversational search data, they have to use artificial datasets for training, which limits their generalizability to real-world search scenarios. As a result, the industry has shown reluctance to implement them in reality, further suspending the availability of real conversational search interaction data. The above dilemma can be formulated as a cold start problem of clarifying question generation and conversational search in general. Furthermore, even if we do have large-scale conversational logs, it is not realistic to gather training data that can comprehensively cover all possible queries and topics in open-domain search scenarios. The risk of fitting bias when training a clarifying question retrieval/generation model on incomprehensive dataset is thus another important challenge. In this work, we innovatively explore generating clarifying questions in a zero-shot setting to overcome the cold start problem and we propose a constrained clarifying question generation system which uses both question templates and query facets to guide the effective and precise question generation. The experiment results show that our method outperforms existing state-of-the-art zero-shot baselines by a large margin. Human annotations to our model outputs also indicate our method generates 25.2\% more natural questions, 18.1\% more useful questions, 6.1\% less unnatural and 4\% less useless questions.

📄 PDF Abstract BibTeX arXiv:2301.12660

Code (0)

등록된 구현이 없습니다.

Tasks

Conversational SearchNatural QuestionsQuestion GenerationQuestion-GenerationRetrieval

Similar Papers 제목 키워드 기반

Zero-Shot and Efficient Clarification Need Prediction in Conversational Search

2025-02-28 · Lili Lu, Chuan Meng, Federico Ravenda, Mohammad Aliannejadi 외

Clarification need prediction (CNP) is a key task in conversational search, aiming to predict whether to ask a clarifying question or give an answer to the current user query. However, current research on CNP suffers fro…

Conversational Searchcounterfactual

Evaluating Mixed-initiative Conversational Search Systems via User Simulation

2022-04-17 · Ivan Sekulić, Mohammad Aliannejadi, Fabio Crestani

Clarifying the underlying user information need by asking clarifying questions is an important feature of modern conversational search system. However, evaluation of such systems through answering prompted clarifying que…

Conversational SearchText GenerationUser Simulation

PAQA: Toward ProActive Open-Retrieval Question Answering

2024-02-26 · Pierre Erbacher, Jian-Yun Nie, Philippe Preux, Laure Soulier

Conversational systems have made significant progress in generating natural language responses. However, their potential as conversational search systems is currently limited due to their passive role in the information-…

Conversational SearchPassage RetrievalQuestion AnsweringRetrieval

AGENT-CQ: Automatic Generation and Evaluation of Clarifying Questions for Conversational Search with LLMs

2024-10-25 · Clemencia Siro, Yifei Yuan, Mohammad Aliannejadi, Maarten de Rijke

Generating diverse and effective clarifying questions is crucial for improving query understanding and retrieval performance in open-domain conversational search (CS) systems. We propose AGENT-CQ (Automatic GENeration, a…

Conversational SearchRetrieval

Do Images Clarify? A Study on the Effect of Images on Clarifying Questions in Conversational Search

2026-02-09 · Clemencia Siro, Zahra Abbasiantaeb, Yifei Yuan, Mohammad Aliannejadi 외 arxiv

Conversational search systems increasingly employ clarifying questions to refine user queries and improve the search experience. Previous studies have demonstrated the usefulness of text-based clarifying questions in enh…

Question Answering