Exploiting Morphological Regularities in Distributional Word Representations
We present an unsupervised, language agnostic approach for exploiting morphological regularities present in high dimensional vector spaces. We propose a novel method for generating embeddings of words from their morphological variants using morphological transformation operators. We evaluate this approach on MSR word analogy test set with an accuracy of 85{\%} which is 12{\%} higher than the previous best known system.
Code (0)
등록된 구현이 없습니다.
Tasks
ChunkingDocument ClassificationQuestion AnsweringWord EmbeddingsSimilar Papers 제목 키워드 기반
From Characters to Words to in Between: Do We Capture Morphology?
Words can be represented by composing the representations of subword units such as word segments, characters, and/or character n-grams. While such representations are effective and may capture the morphological regularit…
Language ModelingLanguage ModellingIndicatements that character language models learn English morpho-syntactic units and regularities
Character language models have access to surface morphological patterns, but it is not clear whether or how they learn abstract morphological regularities. We instrument a character language model with several probes, fi…
Language ModelingLanguage Modelling`Indicatements' that character language models learn English morpho-syntactic units and regularities
Character language models have access to surface morphological patterns, but it is not clear whether or \textit{how} they learn abstract morphological regularities. We instrument a character language model with several p…
Feature EngineeringLanguage ModelingLanguage ModellingMachine Translation+2Compositional-ly Derived Representations of Morphologically Complex Words in Distributional Semantics
Analogical Reasoning on Chinese Morphological and Semantic Relations
Analogical reasoning is effective in capturing linguistic regularities. This paper proposes an analogical reasoning task on Chinese. After delving into Chinese lexical knowledge, we sketch 68 implicit morphological relat…
Word Embeddings