Efficient Adversarial Attacks on Online Multi-agent Reinforcement Learning

2023-07-15 · NeurIPS 2023 11

Due to the broad range of applications of multi-agent reinforcement learning (MARL), understanding the effects of adversarial attacks against MARL model is essential for the safe applications of this model. Motivated by this, we investigate the impact of adversarial attacks on MARL. In the considered setup, there is an exogenous attacker who is able to modify the rewards before the agents receive them or manipulate the actions before the environment receives them. The attacker aims to guide each agent into a target policy or maximize the cumulative rewards under some specific reward function chosen by the attacker, while minimizing the amount of manipulation on feedback and action. We first show the limitations of the action poisoning only attacks and the reward poisoning only attacks. We then introduce a mixed attack strategy with both the action poisoning and the reward poisoning. We show that the mixed attack strategy can efficiently attack MARL agents even if the attacker has no prior information about the underlying environment and the agents' algorithms.

📄 PDF Abstract BibTeX arXiv:2307.07670

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning

Online Robustness Training for Deep Reinforcement Learning

2019-11-03 · Marc Fischer, Matthew Mirman, Steven Stalder, Martin Vechev

In deep reinforcement learning (RL), adversarial attacks can trick an agent into unwanted states and disrupt training. We propose a system called Robust Student-DQN (RS-DQN), which permits online robustness training alon…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Adversarial Inception Backdoor Attacks against Reinforcement Learning

2024-10-17 · Ethan Rathbun, Alina Oprea, Christopher Amato

Recent works have demonstrated the vulnerability of Deep Reinforcement Learning (DRL) algorithms against training-time, backdoor poisoning attacks. The objectives of these attacks are twofold: induce pre-determined, adve…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning

Learning to Cope with Adversarial Attacks

2019-06-28 · Xian Yeow Lee, Aaron Havens, Girish Chowdhary, Soumik Sarkar

The security of Deep Reinforcement Learning (Deep RL) algorithms deployed in real life applications are of a primary concern. In particular, the robustness of RL agents in cyber-physical systems against adversarial attac…

Decision Making Deep Reinforcement Learning Meta-Learning Reinforcement Learning

Enhancing the Robustness of QMIX against State-adversarial Attacks

2023-07-03 · Weiran Guo, Guanjun Liu, Ziyuan Zhou, Ling Wang 외

Deep reinforcement learning (DRL) performance is generally impacted by state-adversarial attacks, a perturbation applied to an agent's observation. Most recent research has concentrated on robust single-agent reinforceme…

Deep Reinforcement Learning Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning

Strategically-timed State-Observation Attacks on Deep Reinforcement Learning Agents

2021-06-18 · ICML Workshop AML 2021 7 · You Qiaoben, Xinning Zhou, Chengyang Ying, Jun Zhu

Deep reinforcement learning (DRL) policies are vulnerable to the adversarial attack on their observations, which may mislead real-world RL agents to catastrophic failures. Several works have shown the effectiveness of t…

Adversarial Attack continuous-control Continuous Control Deep Reinforcement Learning+3