Making Neural Machine Reading Comprehension Faster
This study aims at solving the Machine Reading Comprehension problem where questions have to be answered given a context passage. The challenge is to develop a computationally faster model which will have improved inference time. State of the art in many natural language understanding tasks, BERT model, has been used and knowledge distillation method has been applied to train two smaller models. The developed models are compared with other models which have been developed with the same intention.
Code (0)
등록된 구현이 없습니다.
Tasks
Knowledge DistillationMachine Reading ComprehensionNatural Language UnderstandingReading ComprehensionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Bridging Information-Seeking Human Gaze and Machine Reading Comprehension
In this work, we analyze how human gaze during reading comprehension is conditioned on the given reading comprehension question, and whether this signal can be beneficial for machine reading comprehension. To this end, w…
Machine Reading ComprehensionMultiple-choiceQuestion AnsweringReading ComprehensionAttention-Guided Answer Distillation for Machine Reading Comprehension
Despite that current reading comprehension systems have achieved significant advancements, their promising performances are often obtained at the cost of making an ensemble of numerous models. Besides, existing approache…
Knowledge DistillationMachine Reading ComprehensionReading ComprehensionOn Making Reading Comprehension More Comprehensive
Machine reading comprehension, the task of evaluating a machine{'}s ability to comprehend a passage of text, has seen a surge in popularity in recent years. There are many datasets that are targeted at reading comprehens…
Machine Reading ComprehensionQuestion AnsweringReading ComprehensionA Chinese Machine Reading Comprehension Dataset Automatic Generated Based on Knowledge Graph
“Machine reading comprehension (MRC) is a typical natural language processing (NLP)task and has developed rapidly in the last few years. Various reading comprehension datasets have been built to support MRC studies. Howe…
Dataset GenerationMachine Reading ComprehensionReading ComprehensionDataset for the First Evaluation on Chinese Machine Reading Comprehension
Machine Reading Comprehension (MRC) has become enormously popular recently and has attracted a lot of attention. However, existing reading comprehension datasets are mostly in English. To add diversity in reading compreh…
Chinese Reading ComprehensionDiversityMachine Reading ComprehensionReading Comprehension