Explaining Decentralized Multi-Agent Reinforcement Learning Policies

2025-11-13 · Kayla Boggess, Sarit Kraus, Lu Feng arxiv

Multi-Agent Reinforcement Learning (MARL) has gained significant interest in recent years, enabling sequential decision-making across multiple agents in various domains. However, most existing explanation methods focus on centralized MARL, failing to address the uncertainty and nondeterminism inherent in decentralized settings. We propose methods to generate policy summarizations that capture task ordering and agent cooperation in decentralized MARL policies, along with query-based explanations for When, Why Not, and What types of user queries about specific agent behaviors. We evaluate our approach across four MARL domains and two decentralized MARL algorithms, demonstrating its generalizability and computational efficiency. User studies show that our summarizations and explanations significantly improve user question-answering performance and enhance subjective ratings on metrics such as understanding and satisfaction.

📄 PDF Abstract BibTeX arXiv:2511.10409

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning Computational Efficiency

Decentralized Deterministic Multi-Agent Reinforcement Learning

2021-02-19 · Antoine Grosnit, Desmond Cai, Laura Wynter

[Zhang, ICML 2018] provided the first decentralized actor-critic algorithm for multi-agent reinforcement learning (MARL) that offers convergence guarantees. In that work, policies are stochastic and are defined on finite…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Dealing With Non-stationarity in Decentralized Cooperative Multi-Agent Deep Reinforcement Learning via Multi-Timescale Learning

2023-02-06 · Hadi Nekoei, Akilesh Badrinaaraayanan, Amit Sinha, Mohammad Amini 외

Decentralized cooperative multi-agent deep reinforcement learning (MARL) can be a versatile learning framework, particularly in scenarios where centralized training is either not possible or not practical. One of the cri…

Deep Reinforcement Learning

Cooperative Backdoor Attack in Decentralized Reinforcement Learning with Theoretical Guarantee

2024-05-24 · Mengtong Gao, Yifei Zou, Zuyuan Zhang, Xiuzhen Cheng 외

The safety of decentralized reinforcement learning (RL) is a challenging problem since malicious agents can share their poisoned policies with benign agents. The paper investigates a cooperative backdoor attack in a dece…

Backdoor Attack reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Distributed Policy Iteration for Scalable Approximation of Cooperative Multi-Agent Policies

2019-01-25 · Thomy Phan, Kyrill Schmid, Lenz Belzner, Thomas Gabor 외

Decision making in multi-agent systems (MAS) is a great challenge due to enormous state and joint action spaces as well as uncertainty, making centralized control generally infeasible. Decentralized control offers better…

Decision Making Multi-agent Reinforcement Learning Reinforcement Learning

Decentralized Diffusion Policy Learning for Enhanced Exploration in Cooperative Multi-agent Reinforcement Learning

2026-05-08 · Yuyang Zhang, Haldun Balim, Na Li arxiv

Cooperative multi-agent reinforcement learning (MARL) involves complex agent interactions and requires effective exploration strategies. A prominent class of MARL algorithms, decentralized softmax policy gradient (DecSPG…

Multi-agent Reinforcement Learning