Clozer”:" Adaptable Data Augmentation for Cloze-style Reading Comprehension
Task-adaptive pre-training (TAPT) alleviates the lack of labelled data and provides performance lift by adapting unlabelled data to downstream task. Unfortunately, existing adaptations mainly involve deterministic rules that cannot generalize well. Here, we propose Clozer, a sequence-tagging based cloze answer extraction method used in TAPT that is extendable for adaptation on any cloze-style machine reading comprehension (MRC) downstream tasks. We experiment on multiple-choice cloze-style MRC tasks, and show that Clozer performs significantly better compared to the oracle and state-of-the-art in escalating TAPT effectiveness in lifting model performance, and prove that Clozer is able to recognize the gold answers independently of any heuristics.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationMachine Reading ComprehensionMultiple-choiceReading ComprehensionSimilar Papers 제목 키워드 기반
Clozer: Adaptable Data Augmentation for Cloze-style Reading Comprehension
Task-adaptive pre-training (TAPT) alleviates the lack of labelled data and provides performance lift by adapting unlabelled data to downstream task. Unfortunately, existing adaptations mainly involve deterministic rules …
Data AugmentationMachine Reading ComprehensionMultiple-choiceReading ComprehensionDeepMEL: A Multi-Agent Collaboration Framework for Multimodal Entity Linking
Multimodal Entity Linking (MEL) aims to associate textual and visual mentions with entities in a multimodal knowledge graph. Despite its importance, current methods face challenges such as incomplete contextual informati…
Entity LinkingAttention-over-Attention Neural Networks for Reading Comprehension
Cloze-style queries are representative problems in reading comprehension. Over the past few months, we have seen much progress that utilizing neural network approach to solve Cloze-style questions. In this paper, we pres…
Question AnsweringReading ComprehensionSubword-augmented Embedding for Cloze Reading Comprehension
Representation learning is the foundation of machine reading comprehension. In state-of-the-art models, deep learning methods broadly use word and character level representations. However, character is not naturally the …
Machine Reading ComprehensionReading ComprehensionRepresentation LearningSimple and Effective Semi-Supervised Question Answering
Recent success of deep learning models for the task of extractive Question Answering (QA) is hinged on the availability of large annotated corpora. However, large domain specific annotated corpora are limited and expensi…
Extractive Question-AnsweringQuestion AnsweringTriviaQA