Modular Approach to Machine Reading Comprehension: Mixture of Task-Aware Experts
In this work we present a Mixture of Task-Aware Experts Network for Machine Reading Comprehension on a relatively small dataset. We particularly focus on the issue of common-sense learning, enforcing the common ground knowledge by specifically training different expert networks to capture different kinds of relationships between each passage, question and choice triplet. Moreover, we take inspi ration on the recent advancements of multitask and transfer learning by training each network a relevant focused task. By making the mixture-of-networks aware of a specific goal by enforcing a task and a relationship, we achieve state-of-the-art results and reduce over-fitting.
Code (0)
등록된 구현이 없습니다.
Tasks
Common Sense ReasoningMachine Reading ComprehensionReading ComprehensionTransfer LearningTripletMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Survey of Machine Narrative Reading Comprehension Assessments
As the body of research on machine narrative comprehension grows, there is a critical need for consideration of performance assessment strategies as well as the depth and scope of different benchmark tasks. Based on narr…
Reading ComprehensionSurveySQL Generation via Machine Reading Comprehension
Text-to-SQL systems offers natural language interfaces to databases, which can automatically generates SQL queries given natural language questions. On the WikiSQL benchmark, state-of- the-art text-to-SQL systems typical…
Machine Reading ComprehensionQuestion AnsweringReading Comprehensionslot-filling+3Bridging Information-Seeking Human Gaze and Machine Reading Comprehension
In this work, we analyze how human gaze during reading comprehension is conditioned on the given reading comprehension question, and whether this signal can be beneficial for machine reading comprehension. To this end, w…
Machine Reading ComprehensionMultiple-choiceQuestion AnsweringReading ComprehensionIntegrating Semantic Information into Sketchy Reading Module of Retro-Reader for Vietnamese Machine Reading Comprehension
Machine Reading Comprehension has become one of the most advanced and popular research topics in the fields of Natural Language Processing in recent years. The classification of answerability questions is a relatively si…
Machine Reading ComprehensionReading ComprehensionVietnamese Machine Reading ComprehensionXLM-RDataset for the First Evaluation on Chinese Machine Reading Comprehension
Machine Reading Comprehension (MRC) has become enormously popular recently and has attracted a lot of attention. However, existing reading comprehension datasets are mostly in English. To add diversity in reading compreh…
Chinese Reading ComprehensionDiversityMachine Reading ComprehensionReading Comprehension