Hierarchical Mapping for Crosslingual Word Embedding Alignment
The alignment of word embedding spaces in different languages into a common crosslingual space has recently been in vogue. Strategies that do so compute pairwise alignments and then map multiple languages to a single pivot language (most often English). These strategies, however, are biased towards the choice of the pivot language, given that language proximity and the linguistic characteristics of the target language can strongly impact the resultant crosslingual space in detriment of topologically distant languages. We present a strategy that eliminates the need for a pivot language by learning the mappings across languages in a hierarchical way. Experiments demonstrate that our strategy significantly improves vocabulary induction scores in all existing benchmarks, as well as in a new non-English{--}centered benchmark we built, which we make publicly available.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Automatic Learning of Modality Exclusivity Norms with Crosslingual Word Embeddings
Collecting modality exclusivity norms for lexical items has recently become a common practice in psycholinguistics and cognitive research. However, these norms are available only for a relatively small number of language…
Word EmbeddingsCrosslingual Document Embedding as Reduced-Rank Ridge Regression
There has recently been much interest in extending vector-based word representations to multiple languages, such that words can be compared across languages. In this paper, we shift the focus from words to documents and …
Document EmbeddingregressionRetrievalSentenceMultilingual Training of Crosslingual Word Embeddings
Crosslingual word embeddings represent lexical items from different languages using the same vector space, enabling crosslingual transfer. Most prior work constructs embeddings for a pair of languages, with English on on…
Bilingual Lexicon InductionDependency ParsingDocument ClassificationGeneral Classification+6Filtered Inner Product Projection for Crosslingual Embedding Alignment
Due to widespread interest in machine translation and transfer learning, there are numerous algorithms for mapping multiple embeddings to a shared representation space. Recently, these algorithms have been studied in the…
Machine TranslationTransfer LearningTranslationUnsupervised Word Translation with Adversarial Autoencoder
Crosslingual word embeddings learned from monolingual embeddings have a crucial role in many downstream tasks, ranging from machine translation to transfer learning. Adversarial training has shown impressive success in l…
Machine TranslationTransfer LearningTranslationWord Embeddings+1