U-Net: Machine Reading Comprehension with Unanswerable Questions
Machine reading comprehension with unanswerable questions is a new challenging task for natural language processing. A key subtask is to reliably predict whether the question is unanswerable. In this paper, we propose a unified model, called U-Net, with three important components: answer pointer, no-answer pointer, and answer verifier. We introduce a universal node and thus process the question and its context passage as a single contiguous sequence of tokens. The universal node encodes the fused information from both the question and passage, and plays an important role to predict whether the question is answerable and also greatly improves the conciseness of the U-Net. Different from the state-of-art pipeline models, U-Net can be learned in an end-to-end fashion. The experimental results on the SQuAD 2.0 dataset show that U-Net can effectively predict the unanswerability of questions and achieves an F1 score of 71.7 on SQuAD 2.0.
Code (1)
Tasks
Machine Reading ComprehensionQuestion AnsweringReading ComprehensionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Learning to Ask Unanswerable Questions for Machine Reading Comprehension
Machine reading comprehension with unanswerable questions is a challenging task. In this work, we propose a data augmentation technique by automatically generating relevant unanswerable questions according to an answerab…
Data AugmentationMachine Reading ComprehensionQuestion GenerationQuestion-Generation+1Revealing Weaknesses of Vietnamese Language Models Through Unanswerable Questions in Machine Reading Comprehension
Although the curse of multilinguality significantly restricts the language abilities of multilingual models in monolingual settings, researchers now still have to rely on multilingual models to develop state-of-the-art s…
Machine Reading ComprehensionReading ComprehensionVietnamese Language ModelsVietnamese Machine Reading ComprehensionTo Answer or Not to Answer? Improving Machine Reading Comprehension Model with Span-based Contrastive Learning
Machine Reading Comprehension with Unanswerable Questions is a difficult NLP task, challenged by the questions which can not be answered from passages. It is observed that subtle literal changes often make an answerable …
Contrastive LearningMachine Reading ComprehensionReading ComprehensionIDK-MRC: Unanswerable Questions for Indonesian Machine Reading Comprehension
Machine Reading Comprehension (MRC) has become one of the essential tasks in Natural Language Understanding (NLU) as it is often included in several NLU benchmarks (Liang et al., 2020; Wilie et al., 2020). However, most …
Machine Reading ComprehensionNatural Language UnderstandingQuestion GenerationReading ComprehensionRetrospective Reader for Machine Reading Comprehension
Machine reading comprehension (MRC) is an AI challenge that requires machine to determine the correct answers to questions based on a given passage. MRC systems must not only answer question when necessary but also disti…
Machine Reading ComprehensionQuestion AnsweringReading Comprehension