LMU Bilingual Dictionary Induction System with Word Surface Similarity Scores for BUCC 2020
The task of Bilingual Dictionary Induction (BDI) consists of generating translations for source language words which is important in the framework of machine translation (MT). The aim of the BUCC 2020 shared task is to perform BDI on various language pairs using comparable corpora. In this paper, we present our approach to the task of English-German and English-Russian language pairs. Our system relies on Bilingual Word Embeddings (BWEs) which are often used for BDI when only a small seed lexicon is available making them particularly effective in a low-resource setting. On the other hand, they perform well on high frequency words only. In order to improve the performance on rare words as well, we combine BWE based word similarity with word surface similarity methods, such as orthography In addition to the often used top-n translation method, we experiment with a margin based approach aiming for dynamic number of translations for each source word. We participate in both the open and closed tracks of the shared task and we show improved results of our method compared to simple vector similarity based approaches. Our system was ranked in the top-3 teams and achieved the best results for English-Russian.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationTranslationWord EmbeddingsWord SimilaritySimilar Papers 제목 키워드 기반
On the Limitations of Unsupervised Bilingual Dictionary Induction
Unsupervised machine translation---i.e., not assuming any cross-lingual supervision signal, whether a dictionary, translations, or comparable corpora---seems impossible, but nevertheless, Lample et al. (2018) recently pr…
Graph SimilarityMachine TranslationTranslationUnsupervised Machine TranslationLearning Unsupervised Word Translations Without Adversaries
Word translation, or bilingual dictionary induction, is an important capability that impacts many multilingual language processing tasks. Recent research has shown that word translation can be achieved in an unsupervised…
Machine TranslationMultilingual Word EmbeddingsSensitivityTransfer Learning+3Combining Word Embeddings with Bilingual Orthography Embeddings for Bilingual Dictionary Induction
Bilingual dictionary induction (BDI) is the task of accurately translating words to the target language. It is of great importance in many low-resource scenarios where cross-lingual training data is not available. To per…
TranslationTransliterationWord EmbeddingsBUCC2020: Bilingual Dictionary Induction using Cross-lingual Embedding
This paper presents a deep learning system for the BUCC 2020 shared task: Bilingual dictionary induction from comparable corpora. We have submitted two runs for this shared Task, German (de) and English (en) language pai…
Deep LearningWord EmbeddingsBilingual Dictionary Induction as an Optimization Problem
Bilingual dictionaries are vital in many areas of natural language processing, but such resources are rarely available for lower-density language pairs, especially for those that are closely related. Pivot-based inductio…