Multilingual Training of Crosslingual Word Embeddings

2017-04-01 · EACL 2017 4 · Long Duong, Hiroshi Kanayama, Tengfei Ma, Steven Bird, Trevor Cohn

Crosslingual word embeddings represent lexical items from different languages using the same vector space, enabling crosslingual transfer. Most prior work constructs embeddings for a pair of languages, with English on one side. We investigate methods for building high quality crosslingual word embeddings for many languages in a unified vector space.In this way, we can exploit and combine strength of many languages. We obtained high performance on bilingual lexicon induction, monolingual similarity and crosslingual document classification tasks.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Bilingual Lexicon InductionDependency Parsing Document Classification General Classification Machine TranslationMultilingual Word EmbeddingsNamed Entity Recognition (NER)Sentiment Analysis Transfer LearningWord Embeddings

Beyond Bilingual: Multi-sense Word Embeddings using Multilingual Context

2017-06-25 · WS 2017 8 · Shyam Upadhyay, Kai-Wei Chang, Matt Taddy, Adam Kalai 외

Word embeddings, which represent a word as a point in a vector space, have become ubiquitous to several NLP tasks. A recent line of work uses bilingual (two languages) corpora to learn a different vector for each sense o…

Representation Learning Word Embeddings

Crosslingual Document Embedding as Reduced-Rank Ridge Regression

2019-04-08 · Martin Josifoski, Ivan S. Paskov, Hristo S. Paskov, Martin Jaggi 외

There has recently been much interest in extending vector-based word representations to multiple languages, such that words can be compared across languages. In this paper, we shift the focus from words to documents and …

Document Embedding regression Retrieval Sentence

Learning Multilingual Word Embeddings Using Image-Text Data

2019-05-29 · WS 2019 6 · Karan Singhal, Karthik Raman, Balder ten Cate

There has been significant interest recently in learning multilingual word embeddings -- in which semantically similar words across languages have similar embeddings. State-of-the-art approaches have relied on expensive …

Multilingual Word Embeddings Semantic Similarity Semantic Textual Similarity Word Embeddings

Multi-SimLex: A Large-Scale Evaluation of Multilingual and Crosslingual Lexical Semantic Similarity

2020-12-01 · CL (ACL) 2020 12 · Ivan Vulić, Simon Baker, Edoardo Maria Ponti, Ulla Petti 외

We introduce Multi-SimLex, a large-scale lexical resource and evaluation benchmark covering data sets for 12 typologically diverse languages, including major languages (e.g., Mandarin Chinese, Spanish, Russian) as well a…

Representation Learning Semantic Similarity Semantic Textual Similarity Word Embeddings

OFA: A Framework of Initializing Unseen Subword Embeddings for Efficient Large-scale Multilingual Continued Pretraining

2023-11-15 · Yihong Liu, Peiqin Lin, Mingyang Wang, Hinrich Schütze

Instead of pretraining multilingual language models from scratch, a more efficient method is to adapt existing pretrained language models (PLMs) to new languages via vocabulary extension and continued pretraining. Howeve…

Language Modelling Multilingual Word Embeddings Word Embeddings