On the Robustness of Unsupervised and Semi-supervised Cross-lingual Word Embedding Learning
Cross-lingual word embeddings are vector representations of words in different languages where words with similar meaning are represented by similar vectors, regardless of the language. Recent developments which construct these embeddings by aligning monolingual spaces have shown that accurate alignments can be obtained with little or no supervision. However, the focus has been on a particular controlled scenario for evaluation, and there is no strong evidence on how current state-of-the-art systems would fare with noisy text or for language pairs with major linguistic differences. In this paper we present an extensive evaluation over multiple cross-lingual embedding models, analyzing their strengths and limitations with respect to different variables such as target language, training corpora and amount of supervision. Our conclusions put in doubt the view that high-quality cross-lingual embeddings can always be learned without much supervision.
Code (0)
등록된 구현이 없습니다.
Tasks
Cross-Lingual Word EmbeddingsWord EmbeddingsSimilar Papers 제목 키워드 기반
Semi-Supervised Bilingual Lexicon Induction with Two-way Interaction
Semi-supervision is a promising paradigm for Bilingual Lexicon Induction (BLI) with limited annotations. However, previous semisupervised methods do not fully utilize the knowledge hidden in annotated and nonannotated da…
Bilingual Lexicon InductionVocal Bursts Valence PredictionBilingual Lexicon Induction for Low-Resource Languages using Graph Matching via Optimal Transport
Bilingual lexicons form a critical component of various natural language processing applications, including unsupervised and semisupervised machine translation and crosslingual information retrieval. We improve bilingual…
Bilingual Lexicon InductionGraph MatchingInformation RetrievalMachine Translation+2Bilingual Lexicon Induction for Low-Resource Languages using Graph Matching via Optimal Transport
Bilingual lexicons form a critical component of various NLP applications, including unsupervised and semisupervised machine translation and crosslingual information retrieval. In this work, we improve bilingual lexicon i…
Bilingual Lexicon InductionGraph MatchingInformation RetrievalMachine Translation+2Cross-lingual Feature Extraction from Monolingual Corpora for Low-resource Unsupervised Bilingual Lexicon Induction
Despite their progress in high-resource language settings, unsupervised bilingual lexicon induction (UBLI) models often fail on corpora with low-resource distant language pairs due to insufficient initialization. In this…
Bilingual Lexicon InductionWord EmbeddingsA Simple Approach to Learning Unsupervised Multilingual Embeddings
Recent progress on unsupervised learning of cross-lingual embeddings in bilingual setting has given impetus to learning a shared embedding space for several languages without any supervision. A popular framework to solve…
Bilingual Lexicon InductionDependency ParsingDocument ClassificationWord Alignment+1