Effective Character-augmented Word Embedding for Machine Reading Comprehension
Machine reading comprehension is a task to model relationship between passage and query. In terms of deep learning framework, most of state-of-the-art models simply concatenate word and character level representations, which has been shown suboptimal for the concerned task. In this paper, we empirically explore different integration strategies of word and character embeddings and propose a character-augmented reader which attends character-level representation to augment word embedding with a short list to improve word representations, especially for rare words. Experimental results show that the proposed approach helps the baseline model significantly outperform state-of-the-art baselines on various public benchmarks.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine Reading ComprehensionReading ComprehensionSimilar Papers 제목 키워드 기반
Effective Subword Segmentation for Text Comprehension
Representation learning is the foundation of machine reading comprehension and inference. In state-of-the-art models, character-level representations have been broadly adopted to alleviate the problem of effectively repr…
Machine Reading ComprehensionReading ComprehensionRepresentation LearningSegmentationSubword-augmented Embedding for Cloze Reading Comprehension
Representation learning is the foundation of machine reading comprehension. In state-of-the-art models, deep learning methods broadly use word and character level representations. However, character is not naturally the …
Machine Reading ComprehensionReading ComprehensionRepresentation LearningRadical-level Ideograph Encoder for RNN-based Sentiment Analysis of Chinese and Japanese
The character vocabulary can be very large in non-alphabetic languages such as Chinese and Japanese, which makes neural network models huge to process such languages. We explored a model for sentiment classification that…
General ClassificationSentiment AnalysisSentiment ClassificationCharacter-based Neural Networks for Sentence Pair Modeling
Sentence pair modeling is critical for many NLP tasks, such as paraphrase identification, semantic textual similarity, and natural language inference. Most state-of-the-art neural models for these tasks rely on pretraine…
Language ModelingLanguage ModellingNatural Language InferenceParaphrase Identification+4On Learning Word Embeddings From Linguistically Augmented Text Corpora
Word embedding is a technique in Natural Language Processing (NLP) to map words into vector space representations. Since it has boosted the performance of many NLP downstream tasks, the task of learning word embeddings h…
Learning Word EmbeddingsWord EmbeddingsWord Similarity