BARD-MARL: Byzantine-Agent Detection for Learned Communication in Multi-Agent Reinforcement Learning

2026-06-15 · Almond Kiruthu Murimi arxiv

Learned communication improves coordination in cooperative multi-agent reinforcement learning, but it also creates a trust problem: a trained policy may route information through agents that have become faulty or adversarial. This paper studies Byzantine-agent detection for learned-communication MARL in adaptive traffic signal control. We propose BARD-MARL, a post-hoc diagnostic layer on top of BayesG, which is used as an attributed communication substrate rather than as a contribution of this paper. BARD-MARL combines two agent-level evidence streams: policy-graph features extracted from state-action trajectories and Bayesian trust statistics computed from BayesG latent mask probabilities. Across fixed-action, observation-flip, random-noise, and coordinated attacks in SUMO traffic grids, the results show that these signals are complementary rather than universally dominant. On a 25-agent grid, BARD-MARL reaches 0.843 AUC-ROC under a 10% observation-flip attack, while policy-graph-only detection reaches 0.917 AUC-ROC under a 10% coordinated attack. On a 100-agent grid, the unified BARD-MARL variant reaches 0.982 AUC-ROC for both 10% fixed-action and 10% coordinated attacks. The study shows that learned communication policies expose useful diagnostic evidence, but credible resilience claims require attack-specific ablations and explicit separation between coordination, detection, and mitigation.

📄 PDF Abstract BibTeX arXiv:2606.20701

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning

Adaptive Trust Consensus for Blockchain IoT: Comparing RL, DRL, and MARL Against Naive, Collusive, Adaptive, Byzantine, and Sleeper Attacks

2025-12-28 · Soham Padia, Dhananjay Vaidya, Ramchandra Mangrulkar arxiv

Securing blockchain-enabled IoT networks against sophisticated adversarial attacks remains a critical challenge. This paper presents a trust-based delegated consensus framework integrating Fully Homomorphic Encryption (F…

Reinforcement Learning Adversarial Attack

Towards Resilience for Multi-Agent $QD$-Learning

2021-04-07 · Yijing Xie, Shaoshuai Mou, Shreyas Sundaram

This paper considers the multi-agent reinforcement learning (MARL) problem for a networked (peer-to-peer) system in the presence of Byzantine agents. We build on an existing distributed $Q$-learning algorithm, and allow …

All Multi-agent Reinforcement Learning Q-Learning

BRNES: Enabling Security and Privacy-aware Experience Sharing in Multiagent Robotic and Autonomous Systems

2023-08-02 · Md Tamjid Hossain, Hung Manh La, Shahriar Badsha, Anton Netchaev

Although experience sharing (ES) accelerates multiagent reinforcement learning (MARL) in an advisor-advisee framework, attempts to apply ES to decentralized multiagent systems have so far relied on trusted environments a…

SMARLA: A Safety Monitoring Approach for Deep Reinforcement Learning Agents

2023-08-03 · Amirhossein Zolfagharian, Manel Abdellatif, Lionel C. Briand, Ramesh S

Deep Reinforcement Learning (DRL) has made significant advancements in various fields, such as autonomous driving, healthcare, and robotics, by enabling agents to learn optimal policies through interactions with their en…

Autonomous Driving Deep Reinforcement Learning reinforcement-learning Reinforcement Learning

Prioritized Guidance for Efficient Multi-Agent Reinforcement Learning Exploration

2019-07-18 · Qisheng Wang, Qichao Wang

Exploration efficiency is a challenging problem in multi-agent reinforcement learning (MARL), as the policy learned by confederate MARL depends on the collaborative approach among multiple agents. Another important probl…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)