Characterizing Departures from Linearity in Word Translation
We investigate the behavior of maps learned by machine translation methods. The maps translate words by projecting between word embedding spaces of different languages. We locally approximate these maps using linear maps, and find that they vary across the word embedding space. This demonstrates that the underlying maps are non-linear. Importantly, we show that the locally linear maps vary by an amount that is tightly correlated with the distance between the neighborhoods on which they are trained. Our results can be used to test non-linear methods, and to drive the design of more accurate maps for word translation.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationTranslationWord TranslationSimilar Papers 제목 키워드 기반
Understanding Translationese in Multi-view Embedding Spaces
Recent studies use a combination of lexical and syntactic features to show that footprints of the source language remain visible in translations, to the extent that it is possible to predict the original source language …
TranslationLinguistic Matrix Theory
Recent research in computational linguistics has developed algorithms which associate matrices with adjectives and verbs, based on the distribution of words in a corpus of text. These matrices are linear operators on a v…
Lexical Translation Model Using a Deep Neural Network Architecture
In this paper we combine the advantages of a model using global source sentence contexts, the Discriminative Word Lexicon, and neural networks. By using deep neural networks instead of the linear maximum entropy model in…
SentenceTranslationVisualizing and Understanding Neural Machine Translation
While neural machine translation (NMT) has made remarkable progress in recent years, it is hard to interpret its internal workings due to the continuous representations and non-linearity of neural networks. In this work,…
DecoderMachine TranslationNMTTranslationThe Voynich Manuscript is Written in Natural Language: The Pahlavi Hypothesis
The late medieval Voynich Manuscript (VM) has resisted decryption and was considered a meaningless hoax or an unsolvable cipher. Here, we provide evidence that the VM is written in natural language by establishing a rela…
RelationTranslation