Answer-Supervised Question Reformulation for Enhancing Conversational Machine Comprehension
In conversational machine comprehension, it has become one of the research hotspots integrating conversational history information through question reformulation for obtaining better answers. However, the existing question reformulation models are trained only using supervised question labels annotated by annotators without considering any feedback information from answers. In this paper, we propose a novel Answer-Supervised Question Reformulation (ASQR) model for enhancing conversational machine comprehension with reinforcement learning technology. ASQR utilizes a pointer-copy-based question reformulation model as an agent, takes an action to predict the next word, and observes a reward for the whole sentence state after generating the end-of-sequence token. The experimental results on QuAC dataset prove that our ASQR model is more effective in conversational machine comprehension. Moreover, pretraining is essential in reinforcement learning models, so we provide a high-quality annotated dataset for question reformulation by sampling a part of QuAC dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
Reading Comprehensionreinforcement-learningReinforcement LearningReinforcement Learning (RL)SentenceSimilar Papers 제목 키워드 기반
Reinforcement Learning from Reformulations in Conversational Question Answering over Knowledge Graphs
The rise of personal assistants has made conversational question answering (ConvQA) a very popular mechanism for user-system interaction. State-of-the-art methods for ConvQA over knowledge graphs (KGs) can only learn fro…
Conversational Question AnsweringKnowledge GraphsQuestion Answeringreinforcement-learning+1Do Images Clarify? A Study on the Effect of Images on Clarifying Questions in Conversational Search
Conversational search systems increasingly employ clarifying questions to refine user queries and improve the search experience. Previous studies have demonstrated the usefulness of text-based clarifying questions in enh…
Question AnsweringConversational Question Answering with Reformulations over Knowledge Graph
Conversational question answering (convQA) over knowledge graphs (KGs) involves answering multi-turn natural language questions about information contained in a KG. State-of-the-art methods of ConvQA often struggle with …
Conversational Question AnsweringKnowledge GraphsQuestion AnsweringReinforcement Learning (RL)Robust Training for Conversational Question Answering Models with Reinforced Reformulation Generation
Models for conversational question answering (ConvQA) over knowledge graphs (KGs) are usually trained and tested on benchmarks of gold QA pairs. This implies that training is limited to surface forms seen in the respecti…
Conversational Question AnsweringDeep Reinforcement LearningKnowledge GraphsQuestion AnsweringConversational Query Reformulation with the Guidance of Retrieved Documents
Conversational search seeks to retrieve relevant passages for the given questions in conversational question answering. Conversational Query Reformulation (CQR) improves conversational search by refining the original que…
Conversational Question AnsweringConversational SearchLanguage ModellingLarge Language Model+1