From Unsupervised Machine Translation To Adversarial Text Generation
We present a self-attention based bilingual adversarial text generator (B-GAN) which can learn to generate text from the encoder representation of an unsupervised neural machine translation system. B-GAN is able to generate a distributed latent space representation which can be paired with an attention based decoder to generate fluent sentences. When trained on an encoder shared between two languages and paired with the appropriate decoder, it can generate sentences in either language. B-GAN is trained using a combination of reconstruction loss for auto-encoder, a cross domain loss for translation and a GAN based adversarial loss for text generation. We demonstrate that B-GAN, trained on monolingual corpora only using multiple losses, generates more fluent sentences compared to monolingual baselines while effectively using half the number of parameters.
Code (0)
등록된 구현이 없습니다.
Tasks
Adversarial TextDecoderMachine TranslationText GenerationTranslationUnsupervised Machine TranslationSimilar Papers 제목 키워드 기반
Bilingual-GAN: A Step Towards Parallel Text Generation
Latent space based GAN methods and attention based sequence to sequence models have achieved impressive results in text generation and unsupervised machine translation respectively. Leveraging the two domains, we propose…
DecoderDenoisingMachine TranslationText Generation+2Unsupervised Sign Language Translation and Generation
Motivated by the success of unsupervised neural machine translation (UNMT), we introduce an unsupervised sign language translation and generation network (USLNet), which learns from abundant single-modality (text and vid…
Machine TranslationSign Language TranslationTranslationRobust Unsupervised Neural Machine Translation with Adversarial Denoising Training
Unsupervised neural machine translation (UNMT) has recently attracted great interest in the machine translation community. The main advantage of the UNMT lies in its easy collection of required large training text senten…
DenoisingMachine TranslationTranslationLost In Translation: Generating Adversarial Examples Robust to Round-Trip Translation
Language Models today provide a high accuracy across a large number of downstream tasks. However, they remain susceptible to adversarial attacks, particularly against those where the adversarial examples maintain conside…
Machine TranslationTranslationCycleVAR: Repurposing Autoregressive Model for Unsupervised One-Step Image Translation
The current conditional autoregressive image generation methods have shown promising results, yet their potential remains largely unexplored in the practical unsupervised image translation domain, which operates without …
Image GenerationImage-to-Image TranslationQuantizationTranslation