Exploiting Similarities among Languages for Machine Translation
Dictionaries and phrase tables are the basis of modern statistical machine translation systems. This paper develops a method that can automate the process of generating and extending dictionaries and phrase tables. Our method can translate missing word and phrase entries by learning language structures based on large monolingual data and mapping between languages from small bilingual data. It uses distributed representation of words and learns a linear mapping between vector spaces of languages. Despite its simplicity, our method is surprisingly effective: we can achieve almost 90% precision@5 for translation of words between English and Spanish. This method makes little assumption about the languages, so it can be used to extend and refine dictionaries and translation tables for any language pairs.
Code (8)
Tasks
Machine TranslationTranslationSimilar Papers 제목 키워드 기반
Utilizing Language Relatedness to improve Machine Translation: A Case Study on Languages of the Indian Subcontinent
In this work, we present an extensive study of statistical machine translation involving languages of the Indian subcontinent. These languages are related by genetic and contact relationships. We describe the similaritie…
Machine TranslationTranslationFeature-based Decipherment for Large Vocabulary Machine Translation
Orthographic similarities across languages provide a strong signal for probabilistic decipherment, especially for closely related language pairs. The existing decipherment models, however, are not well-suited for exploit…
DeciphermentMachine TranslationTranslationExploiting Transliterated Words for Finding Similarity in Inter-Language News Articles using Machine Learning
Finding similarities between two inter-language news articles is a challenging problem of Natural Language Processing (NLP). It is difficult to find similar news articles in a different language other than the native lan…
ArticlesMachine Translationtext-to-speechText to Speech+1Feature-Based Decipherment for Machine Translation
Orthographic similarities across languages provide a strong signal for unsupervised probabilistic transduction (decipherment) for closely related language pairs. The existing decipherment models, however, are not well su…
DeciphermentMachine TranslationTranslationWord AlignmentThe Impact of Syntactic and Semantic Proximity on Machine Translation with Back-Translation
Unsupervised on-the-fly back-translation, in conjunction with multilingual pretraining, is the dominant method for unsupervised neural machine translation. Theoretically, however, the method should not work in general. W…
Machine TranslationTranslationUnsupervised Machine Translation