Word Embedding Transformation for Robust Unsupervised Bilingual Lexicon Induction
Great progress has been made in unsupervised bilingual lexicon induction (UBLI) by aligning the source and target word embeddings independently trained on monolingual corpora. The common assumption of most UBLI models is that the embedding spaces of two languages are approximately isomorphic. Therefore the performance is bound by the degree of isomorphism, especially on etymologically and typologically distant languages. To address this problem, we propose a transformation-based method to increase the isomorphism. Embeddings of two languages are made to match with each other by rotating and scaling. The method does not require any form of supervision and can be applied to any language pair. On a benchmark data set of bilingual lexicon induction, our approach can achieve competitive or superior performance compared to state-of-the-art methods, with particularly strong results being found on distant languages.
Code (0)
등록된 구현이 없습니다.
Tasks
Bilingual Lexicon InductionWord EmbeddingsSimilar Papers 제목 키워드 기반
Low-resource bilingual lexicon extraction using graph based word embeddings
In this work we focus on the task of automatically extracting bilingual lexicon for the language pair Spanish-Nahuatl. This is a low-resource setting where only a small amount of parallel corpus is available. Most of the…
TranslationWord AlignmentWord EmbeddingsA Graph-based Coarse-to-fine Method for Unsupervised Bilingual Lexicon Induction
Unsupervised bilingual lexicon induction is the task of inducing word translations from monolingual corpora of two languages. Recent methods are mostly based on unsupervised cross-lingual word embeddings, the key to whic…
Bilingual Lexicon InductionCross-Lingual Word EmbeddingsWord EmbeddingsWord TranslationUnsupervised Cross-lingual Transfer of Word Embedding Spaces
Cross-lingual transfer of word embeddings aims to establish the semantic mappings among words in different languages by learning the transformation functions over the corresponding word embedding spaces. Successfully sol…
Bilingual Lexicon InductionCross-Lingual Transfertext-classificationText Classification+2Refinement of Unsupervised Cross-Lingual Word Embeddings
Cross-lingual word embeddings aim to bridge the gap between high-resource and low-resource languages by allowing to learn multilingual word representations even without using any direct bilingual signal. The lion's share…
Bilingual Lexicon InductionCross-Lingual Word EmbeddingsWord EmbeddingsBilingual Lexicon Induction through Unsupervised Machine Translation
A recent research line has obtained strong results on bilingual lexicon induction by aligning independently trained word embeddings in two languages and using the resulting cross-lingual embeddings to induce word transla…
Bilingual Lexicon InductionLanguage ModelingLanguage ModellingMachine Translation+6