A Comparative Study of Word Embeddings for Reading Comprehension
The focus of past machine learning research for Reading Comprehension tasks has been primarily on the design of novel deep learning architectures. Here we show that seemingly minor choices made on (1) the use of pre-trained word embeddings, and (2) the representation of out-of-vocabulary tokens at test time, can turn out to have a larger impact than architectural choices on the final performance. We systematically explore several options for these choices, and provide recommendations to researchers working in this area.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningReading ComprehensionWord EmbeddingsSimilar Papers 제목 키워드 기반
An Experimental Study of Deep Neural Network Models for Vietnamese Multiple-Choice Reading Comprehension
Machine reading comprehension (MRC) is a challenging task in natural language processing that makes computers understanding natural language texts and answer questions based on those texts. There are many techniques for …
Machine Reading ComprehensionMultiple-choiceReading ComprehensionWord EmbeddingsModeling semantic association in self-paced reading with language model embeddings
Semantic association between a word and its context has been identified as an important component of reading comprehension, even when word predictability is accounted for. Recent research has highlighted the potential of…
Reading ComprehensionEffective Character-augmented Word Embedding for Machine Reading Comprehension
Machine reading comprehension is a task to model relationship between passage and query. In terms of deep learning framework, most of state-of-the-art models simply concatenate word and character level representations, w…
Machine Reading ComprehensionReading ComprehensionOptimizing Odia Braille Literacy: The Influence of Speed on Error Reduction and Enhanced Comprehension
This study aims to conduct an extensive detailed analysis of the Odia Braille reading comprehension among students with visual disability. Specifically, the study explores their reading speed and hand or finger movements…
Reading ComprehensionLearning to Compute Word Embeddings On the Fly
Words in natural language follow a Zipfian distribution whereby some words are frequent but most are rare. Learning representations for words in the "long tail" of this distribution requires enormous amounts of data. Rep…
Language ModelingLanguage ModellingNatural Language InferenceQuestion Answering+2