paper-with-me

Papers

Semi-Supervised Learning for Bilingual Lexicon Induction

2024-02-10 · Paul Garnier, Gauthier Guinet

We consider the problem of aligning two sets of continuous word representations, corresponding to languages, to a common space in order to infer a bilingual lexicon. It was recently shown that it is possible to infer such lexicon, without using any parallel data, by aligning word embeddings trained on monolingual data. Such line of work is called unsupervised bilingual induction. By wondering whether it was possible to gain experience in the progressive learning of several languages, we asked ourselves to what extent we could integrate the knowledge of a given set of languages when learning a new one, without having parallel data for the latter. In other words, while keeping the core problem of unsupervised learning in the latest step, we allowed the access to other corpora of idioms, hence the name semi-supervised. This led us to propose a novel formulation, considering the lexicon induction as a ranking problem for which we used recent tools of this machine learning field. Our experiments on standard benchmarks, inferring dictionary from English to more than 20 languages, show that our approach consistently outperforms existing state of the art benchmark. In addition, we deduce from this new scenario several relevant conclusions allowing a better understanding of the alignment phenomenon.

📄 PDF Abstract BibTeX arXiv:2402.07028

Code (2)

gguinet/semisupervised-alignement 공식 구현 tf
gguinet/semisupervised-alignment 공식 구현 tf

Tasks

Bilingual Lexicon InductionWord Embeddings

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Bilingual Lexicon Induction for Low-Resource Languages using Graph Matching via Optimal Transport

2022-10-25 · Kelly Marchisio, Ali Saad-Eldin, Kevin Duh, Carey Priebe 외

Bilingual lexicons form a critical component of various natural language processing applications, including unsupervised and semisupervised machine translation and crosslingual information retrieval. We improve bilingual…

Bilingual Lexicon InductionGraph MatchingInformation RetrievalMachine Translation+2

Bilingual Lexicon Induction for Low-Resource Languages using Graph Matching via Optimal Transport

2022-01-16 · ACL ARR January 2022 1 · Anonymous

Bilingual lexicons form a critical component of various NLP applications, including unsupervised and semisupervised machine translation and crosslingual information retrieval. In this work, we improve bilingual lexicon i…

Bilingual Lexicon InductionGraph MatchingInformation RetrievalMachine Translation+2

Bilingual Lexicon Induction with Semi-supervision in Non-Isometric Embedding Spaces

2019-08-19 · ACL 2019 7 · Barun Patra, Joel Ruben Antony Moniz, Sarthak Garg, Matthew R. Gormley 외

Recent work on bilingual lexicon induction (BLI) has frequently depended either on aligned bilingual lexicons or on distribution matching, often with an assumption about the isometry of the two spaces. We propose a techn…

Bilingual Lexicon InductionWord Embeddings

An Alignment-Based Approach to Semi-Supervised Bilingual Lexicon Induction with Small Parallel Corpora

2021-08-01 · MTSummit 2021 8 · Kelly Marchisio, Philipp Koehn, Conghao Xiong

Aimed at generating a seed lexicon for use in downstream natural language tasks and unsupervised methods for bilingual lexicon induction have received much attention in the academic literature recently. While interesting…

Bilingual Lexicon InductionTranslation

Bilingual Lexicon Induction across Orthographically-distinct Under-Resourced Dravidian Languages

2020-12-01 · VarDial (COLING) 2020 12 · Bharathi Raja Chakravarthi, Navaneethan Rajasekaran, Mihael Arcan, Kevin McGuinness 외

Bilingual lexicons are a vital tool for under-resourced languages and recent state-of-the-art approaches to this leverage pretrained monolingual word embeddings using supervised or semi-supervised approaches. However, th…

Bilingual Lexicon InductionWord Embeddings