A Reinforced Generation of Adversarial Examples for Neural Machine Translation
Neural machine translation systems tend to fail on less decent inputs despite its significant efficacy, which may significantly harm the credibility of this systems-fathoming how and when neural-based systems fail in such cases is critical for industrial maintenance. Instead of collecting and analyzing bad cases using limited handcrafted error features, here we investigate this issue by generating adversarial examples via a new paradigm based on reinforcement learning. Our paradigm could expose pitfalls for a given performance metric, e.g., BLEU, and could target any given neural machine translation architecture. We conduct experiments of adversarial attacks on two mainstream neural machine translation architectures, RNN-search, and Transformer. The results show that our method efficiently produces stable attacks with meaning-preserving adversarial examples. We also present a qualitative and quantitative analysis for the preference pattern of the attack, demonstrating its capability of pitfall exposure.
Code (1)
Tasks
Machine TranslationReinforcement LearningTranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Lost In Translation: Generating Adversarial Examples Robust to Round-Trip Translation
Language Models today provide a high accuracy across a large number of downstream tasks. However, they remain susceptible to adversarial attacks, particularly against those where the adversarial examples maintain conside…
Machine TranslationTranslationRobust Neural Machine Translation with Doubly Adversarial Inputs
Neural machine translation (NMT) often suffers from the vulnerability to noisy perturbations in the input. We propose an approach to improving the robustness of NMT models, which consists of two parts: (1) attack the tra…
Machine TranslationNMTTranslationCrafting Adversarial Examples for Neural Machine Translation
Effective adversary generation for neural machine translation (NMT) is a crucial prerequisite for building robust machine translation systems. In this work, we investigate veritable evaluations of NMT adversarial attacks…
Machine TranslationNMTTranslationvalidPAEG: Phrase-level Adversarial Example Generation for Neural Machine Translation
While end-to-end neural machine translation (NMT) has achieved impressive progress, noisy input usually leads models to become fragile and unstable. Generating adversarial examples as the augmented data has been proved t…
Machine TranslationNMTTranslationImproving Neural Machine Translation with Conditional Sequence Generative Adversarial Nets
This paper proposes an approach for applying GANs to NMT. We build a conditional sequence generative adversarial net which comprises of two adversarial sub models, a generator and a discriminator. The generator aims to g…
Machine TranslationNMTSentenceTranslation