Unsupervised Hyperalignment for Multilingual Word Embeddings
We consider the problem of aligning continuous word representations, learned in multiple languages, to a common space. It was recently shown that, in the case of two languages, it is possible to learn such a mapping without supervision. This paper extends this line of work to the problem of aligning multiple languages to a common space. A solution is to independently map all languages to a pivot language. Unfortunately, this degrades the quality of indirect word translation. We thus propose a novel formulation that ensures composable mappings, leading to better alignments. We evaluate our method by jointly aligning word vectors in eleven languages, showing consistent improvement with indirect mappings while maintaining competitive performance on direct word translation.
Code (0)
등록된 구현이 없습니다.
Tasks
Multilingual Word EmbeddingsTranslationWord EmbeddingsWord TranslationSimilar Papers 제목 키워드 기반
Unsupervised Multilingual Word Embeddings
Multilingual Word Embeddings (MWEs) represent words from multiple languages in a single distributional vector space. Unsupervised MWE (UMWE) methods acquire multilingual embeddings without cross-lingual supervision, whic…
Multilingual Word EmbeddingsTranslationWord EmbeddingsWord Similarity+1Multilingual Word Embeddings using Multigraphs
We present a family of neural-network--inspired models for computing continuous word representations, specifically designed to exploit both monolingual and multilingual text. This framework allows us to perform unsupervi…
Machine TranslationMultilingual Word EmbeddingsSemantic SimilaritySemantic Textual Similarity+2Unsupervised Alignment of Embeddings with Wasserstein Procrustes
A library for Multilingual Unsupervised or Supervised word Embeddings
Word EmbeddingsLearning Unsupervised Multilingual Word Embeddings with Incremental Multilingual Hubs
Recent research has discovered that a shared bilingual word embedding space can be induced by projecting monolingual word embedding spaces from two languages using a self-learning paradigm without any bilingual supervisi…
Bilingual Lexicon InductionCross-Lingual Word EmbeddingsDependency ParsingDocument Classification+3A Simple Approach to Learning Unsupervised Multilingual Embeddings
Recent progress on unsupervised learning of cross-lingual embeddings in bilingual setting has given impetus to learning a shared embedding space for several languages without any supervision. A popular framework to solve…
Bilingual Lexicon InductionDependency ParsingDocument ClassificationWord Alignment+1