Black-Box Targeted Reward Poisoning Attack Against Online Deep Reinforcement Learning
We propose the first black-box targeted attack against online deep reinforcement learning through reward poisoning during training time. Our attack is applicable to general environments with unknown dynamics learned by unknown algorithms and requires limited attack budgets and computational resources. We leverage a general framework and find conditions to ensure efficient attack under a general assumption of the learning algorithms. We show that our attack is optimal in our framework under the conditions. We experimentally verify that with limited budgets, our attack efficiently leads the learning agent to various target policies under a diverse set of popular DRL environments and state-of-the-art learners.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep Reinforcement Learningreinforcement-learningSimilar Papers 제목 키워드 기반
Universal Black-Box Reward Poisoning Attack against Offline Reinforcement Learning
We study the problem of universal black-boxed reward poisoning attacks against general offline reinforcement learning with deep neural networks. We consider a black-box threat model where the attacker is entirely oblivio…
Offline RLreinforcement-learningReinforcement LearningReward Poisoning in Reinforcement Learning: Attacks Against Unknown Learners in Unknown Environments
We study black-box reward poisoning attacks against reinforcement learning (RL), in which an adversary aims to manipulate the rewards to mislead a sequence of RL agents with unknown algorithms to learn a nefarious policy…
reinforcement-learningReinforcement Learning (RL)Online Poisoning Attack Against Reinforcement Learning under Black-box Environments
This paper proposes an online environment poisoning algorithm tailored for reinforcement learning agents operating in a black-box setting, where an adversary deliberately manipulates training data to lead the agent towar…
reinforcement-learningReinforcement LearningBroadly Applicable Targeted Data Sample Omission Attacks
We introduce a novel clean-label targeted poisoning attack on learning mechanisms. While classical poisoning attacks typically corrupt data via addition, modification and omission, our attack focuses on data omission onl…
PAC learningA Targeted Attack on Black-Box Neural Machine Translation with Parallel Data Poisoning
As modern neural machine translation (NMT) systems have been widely deployed, their security vulnerabilities require close scrutiny. Most recently, NMT systems have been found vulnerable to targeted attacks which cause t…
Data PoisoningMachine TranslationNMTTranslation