Distributed Multi-Agent Deep Reinforcement Learning for Robust Coordination against Noise

2022-05-19 · Yoshinari Motokawa, Toshiharu Sugawara

In multi-agent systems, noise reduction techniques are important for improving the overall system reliability as agents are required to rely on limited environmental information to develop cooperative and coordinated behaviors with the surrounding agents. However, previous studies have often applied centralized noise reduction methods to build robust and versatile coordination in noisy multi-agent environments, while distributed and decentralized autonomous agents are more plausible for real-world application. In this paper, we introduce a \emph{distributed attentional actor architecture model for a multi-agent system} (DA3-X), using which we demonstrate that agents with DA3-X can selectively learn the noisy environment and behave cooperatively. We experimentally evaluate the effectiveness of DA3-X by comparing learning methods with and without DA3-X and show that agents with DA3-X can achieve better performance than baseline agents. Furthermore, we visualize heatmaps of \emph{attentional weights} from the DA3-X to analyze how the decision-making process and coordinated behavior are influenced by noise.

📄 PDF Abstract BibTeX arXiv:2205.09705

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingDeep Reinforcement Learningreinforcement-learning Reinforcement Learning (RL)

Coordinated Attacks Against Federated Learning: A Multi-Agent Reinforcement Learning Approach

2021-09-29 · Wen Shen, Henger Li, Zizhan Zheng

We propose a model-based multi-agent reinforcement learning attack framework against federated learning systems. Our framework first approximates the distribution of the clients' aggregated data through cooperative multi…

Federated Learning Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Centralised rehearsal of decentralised cooperation: Multi-agent reinforcement learning for the scalable coordination of residential energy flexibility

2023-05-30 · Flora Charbonnier, Bei Peng, Thomas Morstyn, Malcolm McCulloch

This paper investigates how deep multi-agent reinforcement learning can enable the scalable and privacy-preserving coordination of residential energy flexibility. The coordination of distributed resources such as electri…

Multi-agent Reinforcement Learning Privacy Preserving reinforcement-learning Reinforcement Learning

Distributed Area Coverage with High Altitude Balloons Using Multi-Agent Reinforcement Learning

2025-10-04 · Adam Haroon, Tristan Schuler arxiv

High Altitude Balloons (HABs) can leverage stratospheric wind layers for limited horizontal control, enabling applications in reconnaissance, environmental monitoring, and communications networks. Existing multi-agent HA…

Multi-agent Reinforcement Learning

Privacy-Engineered Value Decomposition Networks for Cooperative Multi-Agent Reinforcement Learning

2023-09-13 · Parham Gohari, Matthew Hale, Ufuk Topcu

In cooperative multi-agent reinforcement learning (Co-MARL), a team of agents must jointly optimize the team's long-term rewards to learn a designated task. Optimizing rewards as a team often requires inter-agent communi…

Multi-agent Reinforcement Learning Privacy Preserving reinforcement-learning SMAC+2

Distributed Cooperative Multi-Agent Reinforcement Learning with Directed Coordination Graph

2022-01-10 · Gangshan Jing, He Bai, Jemin George, Aranya Chakrabortty 외

Existing distributed cooperative multi-agent reinforcement learning (MARL) frameworks usually assume undirected coordination graphs and communication graphs while estimating a global reward via consensus algorithms for p…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)