Interactive Language Learning by Question Answering
Humans observe and interact with the world to acquire knowledge. However, most existing machine reading comprehension (MRC) tasks miss the interactive, information-seeking component of comprehension. Such tasks present models with static documents that contain all necessary information, usually concentrated in a single short substring. Thus, models can achieve strong performance through simple word- and phrase-based pattern matching. We address this problem by formulating a novel text-based question answering task: Question Answering with Interactive Text (QAit). In QAit, an agent must interact with a partially observable text-based environment to gather information required to answer questions. QAit poses questions about the existence, location, and attributes of objects found in the environment. The data is built using a text-based game generator that defines the underlying dynamics of interaction with the environment. We propose and evaluate a set of baseline models for the QAit task that includes deep reinforcement learning agents. Experiments show that the task presents a major challenge for machine reading systems, while humans solve it with relative ease.
Code (1)
Tasks
Deep Reinforcement LearningMachine Reading ComprehensionQuestion AnsweringReading ComprehensionReinforcement LearningSimilar Papers 제목 키워드 기반
Interactive Question Answering Systems: Literature Review
Question answering systems are recognized as popular and frequently effective means of information seeking on the web. In such systems, information seekers can receive a concise response to their query by presenting thei…
Question AnsweringA Sequence Modelling Approach to Question Answering in Text-Based Games
Interactive Question Answering (IQA) requires an intelligent agent to interact with a dynamic environment in order to gather information necessary to answer a question. IQA tasks have been proposed as means of training s…
Question Answeringtext-based gamesInteractive Instance-based Evaluation of Knowledge Base Question Answering
Most approaches to Knowledge Base Question Answering are based on semantic parsing. In this paper, we present a tool that aids in debugging of question answering systems that construct a structured semantic representatio…
Entity LinkingKnowledge Base Question AnsweringQuestion AnsweringSemantic ParsingMulti-Agent Embodied Question Answering in Interactive Environments
We investigate a new AI task --- Multi-Agent Interactive Question Answering --- where several agents explore the scene jointly in interactive environments to answer a question. To cooperate efficiently and answer accurat…
3D ReconstructionEmbodied Question AnsweringQuestion AnsweringTeaching Vision-Language Models to Ask: Resolving Ambiguity in Visual Questions
In visual question answering (VQA) context, users often pose ambiguous questions to visual language models (VLMs) due to varying expression habits. Existing research addresses such ambiguities primarily by rephrasing que…
Visual Question Answering