Refinement of Unsupervised Cross-Lingual Word Embeddings
Cross-lingual word embeddings aim to bridge the gap between high-resource and low-resource languages by allowing to learn multilingual word representations even without using any direct bilingual signal. The lion's share of the methods are projection-based approaches that map pre-trained embeddings into a shared latent space. These methods are mostly based on the orthogonal transformation, which assumes language vector spaces to be isomorphic. However, this criterion does not necessarily hold, especially for morphologically-rich languages. In this paper, we propose a self-supervised method to refine the alignment of unsupervised bilingual word embeddings. The proposed model moves vectors of words and their corresponding translations closer to each other as well as enforces length- and center-invariance, thus allowing to better align cross-lingual embeddings. The experimental results demonstrate the effectiveness of our approach, as in most cases it outperforms state-of-the-art methods in a bilingual lexicon induction task.
Code (1)
Tasks
Bilingual Lexicon InductionCross-Lingual Word EmbeddingsWord EmbeddingsSimilar Papers 제목 키워드 기반
Multi-Stage Framework with Refinement Based Point Set Registration for Unsupervised Bi-Lingual Word Alignment
Cross-lingual alignment of word embeddings are important in knowledge transfer across languages, for improving machine translation and other multi-lingual applications. Current unsupervised approaches relying on learning…
Machine TranslationTransfer LearningTranslationWord Alignment+2Multi-Stage Framework with Refinement based Point Set Registration for Unsupervised Bi-Lingual Word Alignment
Cross-lingual alignment of word embeddings play an important role in knowledge transfer across languages, for improving machine translation and other multi-lingual applications. Current unsupervised approaches rely on le…
Machine TranslationSentenceTransfer LearningTranslation+3Unsupervised Word Translation Pairing using Refinement based Point Set Registration
Cross-lingual alignment of word embeddings play an important role in knowledge transfer across languages, for improving machine translation and other multi-lingual applications. Current unsupervised approaches rely on si…
Machine TranslationTransfer LearningTranslationWord Embeddings+1Unsupervised Word Translation with Adversarial Autoencoder
Crosslingual word embeddings learned from monolingual embeddings have a crucial role in many downstream tasks, ranging from machine translation to transfer learning. Adversarial training has shown impressive success in l…
Machine TranslationTransfer LearningTranslationWord Embeddings+1A Graph-based Coarse-to-fine Method for Unsupervised Bilingual Lexicon Induction
Unsupervised bilingual lexicon induction is the task of inducing word translations from monolingual corpora of two languages. Recent methods are mostly based on unsupervised cross-lingual word embeddings, the key to whic…
Bilingual Lexicon InductionCross-Lingual Word EmbeddingsWord EmbeddingsWord Translation