paper-with-me

Papers

Unsupervised Alignment of Distributional Word Embeddings

2022-03-09 · Aissatou Diallo, Johannes Fürnkranz

Cross-domain alignment play a key roles in tasks ranging from machine translation to transfer learning. Recently, purely unsupervised methods operating on monolingual embeddings have successfully been used to infer a bilingual lexicon without relying on supervision. However, current state-of-the art methods only focus on point vectors although distributional embeddings have proven to embed richer semantic information when representing words. In this paper, we propose stochastic optimization approach for aligning probabilistic embeddings. Finally, we evaluate our method on the problem of unsupervised word translation, by aligning word embeddings trained on monolingual data. We show that the proposed approach achieves good performance on the bilingual lexicon induction task across several language pairs and performs better than the point-vector based approach.

📄 PDF Abstract BibTeX arXiv:2203.04863

Code (0)

등록된 구현이 없습니다.

Tasks

Bilingual Lexicon InductionMachine TranslationStochastic OptimizationTransfer LearningTranslationWord EmbeddingsWord Translation

Similar Papers 제목 키워드 기반

Why is unsupervised alignment of English embeddings from different algorithms so hard?

2018-09-01 · EMNLP 2018 10 · Mareike Hartmann, Yova Kementchedjhieva, Anders Søgaard

This paper presents a challenge to the community: Generative adversarial networks (GANs) can perfectly align independent English word embeddings induced using the same algorithm, based on distributional information alone…

Word Embeddings

Unsupervised Multilingual Word Embeddings

2018-08-27 · EMNLP 2018 10 · Xilun Chen, Claire Cardie

Multilingual Word Embeddings (MWEs) represent words from multiple languages in a single distributional vector space. Unsupervised MWE (UMWE) methods acquire multilingual embeddings without cross-lingual supervision, whic…

Multilingual Word EmbeddingsTranslationWord EmbeddingsWord Similarity+1

Unsupervised Learning of Entailment-Vector Word Embeddings

2018-01-01 · ICLR 2018 1 · James Henderson

Entailment vectors are a principled way to encode in a vector what information is known and what is unknown. They are designed to model relations where one vector should include all the information in another vector, ca…

Word Embeddings

Learning Word Embeddings for Hyponymy with Entailment-Based Distributional Semantics

2017-10-06 · James Henderson

Lexical entailment, such as hyponymy, is a fundamental issue in the semantics of natural language. This paper proposes distributional semantic models which efficiently learn word embeddings for entailment, using a recent…

Learning Word EmbeddingsLexical EntailmentWord Embeddings

Learning aligned embeddings for semi-supervised word translation using Maximum Mean Discrepancy

2020-06-20 · Antonio H. O. Fonseca, David van Dijk

Word translation is an integral part of language translation. In machine translation, each language is considered a domain with its own word embedding. The alignment between word embeddings allows linking semantically eq…

Machine TranslationSentenceTranslationWord Alignment+2