Cross-lingual Models of Word Embeddings: An Empirical Comparison
Despite interest in using cross-lingual knowledge to learn word embeddings for various tasks, a systematic comparison of the possible approaches is lacking in the literature. We perform an extensive evaluation of four popular approaches of inducing cross-lingual embeddings, each requiring a different form of supervision, on four typographically different language pairs. Our evaluation setup spans four different tasks, including intrinsic evaluation on mono-lingual and cross-lingual similarity, and extrinsic evaluation on downstream semantic and syntactic applications. We show that models which require expensive cross-lingual knowledge almost always perform better, but cheaply supervised models often prove competitive on certain tasks.
Code (1)
Tasks
Word EmbeddingsSimilar Papers 제목 키워드 기반
A Comparison of Word Embeddings for English and Cross-Lingual Chinese Word Sense Disambiguation
Word embeddings are now ubiquitous forms of word representation in natural language processing. There have been applications of word embeddings for monolingual word sense disambiguation (WSD) in English, but few comparis…
BenchmarkingTranslationWord EmbeddingsWord Sense DisambiguationLinking Tweets with Monolingual and Cross-Lingual News using Transformed Word Embeddings
Social media platforms have grown into an important medium to spread information about an event published by the traditional media, such as news articles. Grouping such diverse sources of information that discuss the sam…
ArticlesWord EmbeddingsA Common Semantic Space for Monolingual and Cross-Lingual Meta-Embeddings
This paper presents a new technique for creating monolingual and cross-lingual meta-embeddings. Our method integrates multiple word embeddings created from complementary techniques, textual sources, knowledge bases and l…
Cross-Lingual TransferPOSPOS TaggingSemantic Textual Similarity+3Graph Exploration and Cross-lingual Word Embeddings for Translation Inference Across Dictionaries
This paper describes the participation of two different approaches in the 3rd Translation Inference Across Dictionaries (TIAD 2020) shared task. The aim of the task is to automatically generate new bilingual dictionaries…
Cross-Lingual Word EmbeddingsTranslationWord EmbeddingsA Comparison of Architectures and Pretraining Methods for Contextualized Multilingual Word Embeddings
The lack of annotated data in many languages is a well-known challenge within the field of multilingual natural language processing (NLP). Therefore, many recent studies focus on zero-shot transfer learning and joint tra…
Multilingual Word Embeddingsnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+7