Anchor-based Bilingual Word Embeddings for Low-Resource Languages
Good quality monolingual word embeddings (MWEs) can be built for languages which have large amounts of unlabeled text. MWEs can be aligned to bilingual spaces using only a few thousand word translation pairs. For low resource languages training MWEs monolingually results in MWEs of poor quality, and thus poor bilingual word embeddings (BWEs) as well. This paper proposes a new approach for building BWEs in which the vector space of the high resource source language is used as a starting point for training an embedding space for the low resource target language. By using the source vectors as anchors the vector spaces are automatically aligned during training. We experiment on English-German, English-Hiligaynon and English-Macedonian. We show that our approach results not only in improved BWEs and bilingual lexicon induction performance, but also in improved target language MWE quality as measured using monolingual word similarity.
Code (0)
등록된 구현이 없습니다.
Tasks
Bilingual Lexicon InductionCross-Lingual TransferTransfer LearningTranslationWord EmbeddingsWord SimilarityWord TranslationSimilar Papers 제목 키워드 기반
Multilingual Word Embeddings for Low-Resource Languages using Anchors and a Chain of Related Languages
Very low-resource languages, having only a few million tokens worth of data, are not well-supported by multilingual NLP approaches due to poor quality cross-lingual word representations. Recent work showed that good cros…
Bilingual Lexicon InductionMultilingual NLPMultilingual Word EmbeddingsWord EmbeddingsMapping Supervised Bilingual Word Embeddings from English to low-resource languages
It is very challenging to work with low-resource languages due to the inadequate availability of data. Using a dictionary to map independently trained word embeddings into a shared vector space has proved to be very usef…
Machine TranslationRetrievalTranslationWord EmbeddingsCross-Lingual Word Embeddings for Turkic Languages
There has been an increasing interest in learning cross-lingual word embeddings to transfer knowledge obtained from a resource-rich language, such as English, to lower-resource languages for which annotated data is scarc…
Cross-Lingual Word EmbeddingsSentiment AnalysisWord EmbeddingsInjecting Word Embeddings with Another Language's Resource : An Application of Bilingual Embeddings
Word embeddings learned from text corpus can be improved by injecting knowledge from external resources, while at the same time also specializing them for similarity or relatedness. These knowledge resources (like WordNe…
Learning Word EmbeddingsWord EmbeddingsWord SimilarityJoint Training for Learning Cross-lingual Embeddings with Sub-word Information without Parallel Corpora
In this paper, we propose a novel method for learning cross-lingual word embeddings, that incorporates sub-word information during training, and is able to learn high-quality embeddings from modest amounts of monolingual…
Bilingual Lexicon InductionClassificationCross-Lingual Word EmbeddingsDocument Classification+2