What should I Ask: A Knowledge-driven Approach for Follow-up Questions Generation in Conversational Surveys
Generating follow-up questions on the fly could significantly improve conversational survey quality and user experiences by enabling a more dynamic and personalized survey structure. In this paper, we proposed a novel task for knowledge-driven follow-up question generation in conversational surveys. We constructed a new human-annotated dataset of human-written follow-up questions with dialogue history and labeled knowledge in the context of conversational surveys. Along with the dataset, we designed and validated a set of reference-free Gricean-inspired evaluation metrics to systematically evaluate the quality of generated follow-up questions. We then propose a two-staged knowledge-driven model for the task, which generates informative and coherent follow-up questions by using knowledge to steer the generation process. The experiments demonstrate that compared to GPT-based baseline models, our two-staged model generates more informative, coherent, and clear follow-up questions.
Code (0)
등록된 구현이 없습니다.
Tasks
Question GenerationQuestion-GenerationSurveySimilar Papers 제목 키워드 기반
Learning Machines: In Search of a Concept Oriented Language
What is the next step after the data/digital revolution? What do we need the most to reach this aim? How machines can memorize, learn or discover? What should they be able to do to be qualified as "intelligent"? These qu…
Decision MakingAI Biases as Asymmetries: A Review to Guide Practice
The understanding of bias in AI is currently undergoing a revolution. Initially understood as errors or flaws, biases are increasingly recognized as integral to AI systems and sometimes preferable to less biased alternat…
What Should I Ask? Using Conversationally Informative Rewards for Goal-Oriented Visual Dialog
The ability to engage in goal-oriented conversations has allowed humans to gain knowledge, reduce uncertainty, and perform tasks more efficiently. Artificial agents, however, are still far behind humans in having goal-dr…
Reinforcement LearningVisual DialogWhat Should I Ask? Using Conversationally Informative Rewards for Goal-oriented Visual Dialog.
The ability to engage in goal-oriented conversations has allowed humans to gain knowledge, reduce uncertainty, and perform tasks more efficiently. Artificial agents, however, are still far behind humans in having goal-dr…
Reinforcement LearningVisual DialogThe Doctor Just Won't Accept That!
Calls to arms to build interpretable models express a well-founded discomfort with machine learning. Should a software agent that does not even know what a loan is decide who qualifies for one? Indeed, we ought to be cau…
BIG-bench Machine LearningInterpretable Machine Learning