Evaluating a Joint Training Approach for Learning Cross-lingual Embeddings with Sub-word Information without Parallel Corpora on Lower-resource Languages
Cross-lingual word embeddings provide a way for information to be transferred between languages. In this paper we evaluate an extension of a joint training approach to learning cross-lingual embeddings that incorporates sub-word information during training. This method could be particularly well-suited to lower-resource and morphologically-rich languages because it can be trained on modest size monolingual corpora, and is able to represent out-of-vocabulary words (OOVs). We consider bilingual lexicon induction, including an evaluation focused on OOVs. We find that this method achieves improvements over previous approaches, particularly for OOVs.
Code (0)
등록된 구현이 없습니다.
Tasks
Bilingual Lexicon InductionCross-Lingual Word EmbeddingsWord EmbeddingsSimilar Papers 제목 키워드 기반
CLUSE: Cross-Lingual Unsupervised Sense Embeddings
This paper proposes a modularized sense induction and representation learning model that jointly learns bilingual sense embeddings that align well in the vector space, where the cross-lingual signal in the English-Chines…
Representation LearningWord SimilarityWasserstein distances for evaluating cross-lingual embeddings
Word embeddings are high dimensional vector representations of words that capture their semantic similarity in the vector space. There exist several algorithms for learning such embeddings both for a single language as w…
Cross-Lingual Document ClassificationDocument ClassificationRetrievalSemantic Similarity+2Unsupervised Joint Training of Bilingual Word Embeddings
State-of-the-art methods for unsupervised bilingual word embeddings (BWE) train a mapping function that maps pre-trained monolingual word embeddings into a bilingual space. Despite its remarkable results, unsupervised ma…
Machine TranslationTranslationUnsupervised Machine TranslationWord EmbeddingsSentiment Analysis for Hinglish Code-mixed Tweets by means of Cross-lingual Word Embeddings
This paper investigates the use of unsupervised cross-lingual embeddings for solving the problem of code-mixed social media text understanding. We specifically investigate the use of these embeddings for a sentiment anal…
Cross-Lingual Word EmbeddingsSentiment AnalysisTransfer LearningWord EmbeddingsJoint Training for Learning Cross-lingual Embeddings with Sub-word Information without Parallel Corpora
In this paper, we propose a novel method for learning cross-lingual word embeddings, that incorporates sub-word information during training, and is able to learn high-quality embeddings from modest amounts of monolingual…
Bilingual Lexicon InductionClassificationCross-Lingual Word EmbeddingsDocument Classification+2