Generating Adversarial Examples with Task Oriented Multi-Objective Optimization
Deep learning models, even the-state-of-the-art ones, are highly vulnerable to adversarial examples. Adversarial training is one of the most efficient methods to improve the model's robustness. The key factor for the success of adversarial training is the capability to generate qualified and divergent adversarial examples which satisfy some objectives/goals (e.g., finding adversarial examples that maximize the model losses for simultaneously attacking multiple models). Therefore, multi-objective optimization (MOO) is a natural tool for adversarial example generation to achieve multiple objectives/goals simultaneously. However, we observe that a naive application of MOO tends to maximize all objectives/goals equally, without caring if an objective/goal has been achieved yet. This leads to useless effort to further improve the goal-achieved tasks, while putting less focus on the goal-unachieved tasks. In this paper, we propose \emph{Task Oriented MOO} to address this issue, in the context where we can explicitly define the goal achievement for a task. Our principle is to only maintain the goal-achieved tasks, while letting the optimizer spend more effort on improving the goal-unachieved tasks. We conduct comprehensive experiments for our Task Oriented MOO on various adversarial example generation schemes. The experimental results firmly demonstrate the merit of our proposed approach. Our code is available at \url{https://github.com/tuananhbui89/TAMOO}.
Code (1)
Similar Papers 제목 키워드 기반
Generating Black-Box Adversarial Examples for Text Classifiers Using a Deep Reinforced Model
Recently, generating adversarial examples has become an important means of measuring robustness of a deep learning model. Adversarial examples help us identify the susceptibilities of the model and further counter those …
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Sentiment Analysis+1A Two-Stage Generative Adversarial Networks With Semantic Content Constraints for Adversarial Example Generation
Deep neural networks (DNNs) have achieved great success in various applications due to their strong expressive power. However, recent studies have shown that DNNs are vulnerable to adversarial examples, and these manip…
OutFlip: Generating Out-of-Domain Samples for Unknown Intent Detection with Natural Language Attack
Out-of-domain (OOD) input detection is vital in a task-oriented dialogue system since the acceptance of unsupported inputs could lead to an incorrect response of the system. This paper proposes OutFlip, a method to gener…
intent-classificationIntent ClassificationIntent DetectionAdvJND: Generating Adversarial Examples with Just Noticeable Difference
Compared with traditional machine learning models, deep neural networks perform better, especially in image classification tasks. However, they are vulnerable to adversarial examples. Adding small perturbations on exampl…
image-classificationImage ClassificationPhaseFool: Phase-oriented Audio Adversarial Examples via Energy Dissipation
Audio adversarial attacks design perturbations onto inputs that lead an automatic speech recognition (ASR) model to predict incorrect outputs. Current audio adversarial attacks optimize perturbations with different const…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Sentencespeech-recognition+1