A Multi-answer Multi-task Framework for Real-world Machine Reading Comprehension
The task of machine reading comprehension (MRC) has evolved from answering simple questions from well-edited text to answering real questions from users out of web data. In the real-world setting, full-body text from multiple relevant documents in the top search results are provided as context for questions from user queries, including not only questions with a single, short, and factual answer, but also questions about reasons, procedures, and opinions. In this case, multiple answers could be equally valid for a single question and each answer may occur multiple times in the context, which should be taken into consideration when we build MRC system. We propose a multi-answer multi-task framework, in which different loss functions are used for multiple reference answers. Minimum Risk Training is applied to solve the multi-occurrence problem of a single answer. Combined with a simple heuristic passage extraction strategy for overlong documents, our model increases the ROUGE-L score on the DuReader dataset from 44.18, the previous state-of-the-art, to 51.09.
Code (0)
등록된 구현이 없습니다.
Tasks
Information RetrievalMachine Reading ComprehensionQuestion AnsweringReading ComprehensionvalidSimilar Papers 제목 키워드 기반
VOGUE: Answer Verbalization through Multi-Task Learning
In recent years, there have been significant developments in Question Answering over Knowledge Graphs (KGQA). Despite all the notable advancements, current KGQA systems only focus on answer generation techniques and not …
Answer GenerationKnowledge GraphsMulti-Task LearningQuestion AnsweringA Multi-World Approach to Question Answering about Real-World Scenes based on Uncertain Input
We propose a method for automatically answering questions about images by bringing together recent advances from natural language processing and computer vision. We combine discrete reasoning with uncertain predictions b…
Question AnsweringDiscovering the Real Association: Multimodal Causal Reasoning in Video Question Answering
Video Question Answering (VideoQA) is challenging as it requires capturing accurate correlations between modalities from redundant information. Recent methods focus on the explicit challenges of the task, e.g. multim…
Question AnsweringVideo Question AnsweringCMQA: A Dataset of Conditional Question Answering with Multiple-Span Answers
Forcing the answer of the Question Answering (QA) task to be a single text span might be restrictive since the answer can be multiple spans in the context. Moreover, we found that multi-span answers often appear with two…
Question AnsweringSynMulti: Synthetic-to-Real Learning for Multimodal Video Understanding
Training multimodal large language models (MLLMs) for video understanding requires large-scale annotated data spanning diverse tasks such as object counting, question answering, and segmentation. However, collecting and …
Video Object SegmentationSynthetic Data GenerationVisual Question AnsweringVisual Grounding