Revisiting Adversarial Autoencoder for Unsupervised Word Translation with Cycle Consistency and Improved Training
Adversarial training has shown impressive success in learning bilingual dictionary without any parallel data by mapping monolingual embeddings to a shared space. However, recent work has shown superior performance for non-adversarial methods in more challenging language pairs. In this work, we revisit adversarial autoencoder for unsupervised word translation and propose two novel extensions to it that yield more stable training and improved results. Our method includes regularization terms to enforce cycle consistency and input reconstruction, and puts the target encoders as an adversary against the corresponding discriminator. Extensive experimentations with European, non-European and low-resource languages show that our method is more robust and achieves better performance than recently proposed adversarial and non-adversarial approaches.
Code (1)
Tasks
TranslationWord TranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Unsupervised Word Translation with Adversarial Autoencoder
Crosslingual word embeddings learned from monolingual embeddings have a crucial role in many downstream tasks, ranging from machine translation to transfer learning. Adversarial training has shown impressive success in l…
Machine TranslationTransfer LearningTranslationWord Embeddings+1Improving Unsupervised Word-by-Word Translation with Language Model and Denoising Autoencoder
Unsupervised learning of cross-lingual word embedding offers elegant matching of words across languages, but has fundamental limitations in translating sentences. In this paper, we propose simple yet effective methods to…
DenoisingLanguage ModelingLanguage ModellingTranslation+1Learning Unsupervised Word Translations Without Adversaries
Word translation, or bilingual dictionary induction, is an important capability that impacts many multilingual language processing tasks. Recent research has shown that word translation can be achieved in an unsupervised…
Machine TranslationMultilingual Word EmbeddingsSensitivityTransfer Learning+3Revisiting Role of Autoencoders in Adversarial Settings
To combat against adversarial attacks, autoencoder structure is widely used to perform denoising which is regarded as gradient masking. In this paper, we revisit the role of autoencoders in adversarial settings. Through …
Adversarial DefenseAdversarial RobustnessDenoisingNon-Adversarial Unsupervised Word Translation
Unsupervised word translation from non-parallel inter-lingual corpora has attracted much research interest. Very recently, neural network methods trained with adversarial loss functions achieved high accuracy on this tas…
CPUTranslationWord Translation