Combining Word Embeddings with Bilingual Orthography Embeddings for Bilingual Dictionary Induction
Bilingual dictionary induction (BDI) is the task of accurately translating words to the target language. It is of great importance in many low-resource scenarios where cross-lingual training data is not available. To perform BDI, bilingual word embeddings (BWEs) are often used due to their low bilingual training signal requirements. They achieve high performance, but problematic cases still remain, such as the translation of rare words or named entities, which often need to be transliterated. In this paper, we enrich BWE-based BDI with transliteration information by using Bilingual Orthography Embeddings (BOEs). BOEs represent source and target language transliteration word pairs with similar vectors. A key problem in our BDI setup is to decide which information source {--} BWEs (or semantics) vs. BOEs (or orthography) {--} is more reliable for a particular word pair. We propose a novel classification-based BDI system that uses BWEs, BOEs and a number of other features to make this decision. We test our system on English-Russian BDI and show improved performance. In addition, we show the effectiveness of our BOEs by successfully using them for transliteration mining based on cosine similarity.
Code (0)
등록된 구현이 없습니다.
Tasks
TranslationTransliterationWord EmbeddingsSimilar Papers 제목 키워드 기반
Evaluating bilingual word embeddings on the long tail
Bilingual word embeddings are useful for bilingual lexicon induction, the task of mining translations of given words. Many studies have shown that bilingual word embeddings perform well for bilingual lexicon induction bu…
Bilingual Lexicon InductionMachine TranslationWord EmbeddingsLMU Bilingual Dictionary Induction System with Word Surface Similarity Scores for BUCC 2020
The task of Bilingual Dictionary Induction (BDI) consists of generating translations for source language words which is important in the framework of machine translation (MT). The aim of the BUCC 2020 shared task is to p…
Machine TranslationTranslationWord EmbeddingsWord SimilarityAdditional Shared Decoder on Siamese Multi-view Encoders for Learning Acoustic Word Embeddings
Acoustic word embeddings --- fixed-dimensional vector representations of arbitrary-length words --- have attracted increasing interest in query-by-example spoken term detection. Recently, on the fact that the orthography…
Decoderspeech-recognitionSpeech RecognitionTriplet+1En-Ar Bilingual Word Embeddings without Word Alignment: Factors Effects
This paper introduces the first attempt to investigate morphological segmentation on En-Ar bilingual word embeddings using bilingual word embeddings model without word alignment (BilBOWA). We investigate the effect of se…
SegmentationSentenceWord AlignmentWord EmbeddingsCombining Static Word Embeddings and Contextual Representations for Bilingual Lexicon Induction
Bilingual Lexicon Induction (BLI) aims to map words in one language to their translations in another, and is typically through learning linear projections to align monolingual word representation spaces. Two classes of w…
Bilingual Lexicon InductionWord Embeddings