On Diagnostics for Understanding Agent Training Behaviour in Cooperative MARL

2023-12-13 · Wiem Khlifi, Siddarth Singh, Omayma Mahjoub, Ruan de Kock, Abidine Vall, Rihab Gorsane, Arnu Pretorius

Cooperative multi-agent reinforcement learning (MARL) has made substantial strides in addressing the distributed decision-making challenges. However, as multi-agent systems grow in complexity, gaining a comprehensive understanding of their behaviour becomes increasingly challenging. Conventionally, tracking team rewards over time has served as a pragmatic measure to gauge the effectiveness of agents in learning optimal policies. Nevertheless, we argue that relying solely on the empirical returns may obscure crucial insights into agent behaviour. In this paper, we explore the application of explainable AI (XAI) tools to gain profound insights into agent behaviour. We employ these diagnostics tools within the context of Level-Based Foraging and Multi-Robot Warehouse environments and apply them to a diverse array of MARL algorithms. We demonstrate how our diagnostics can enhance the interpretability and explainability of MARL systems, providing a better understanding of agent behaviour.

📄 PDF Abstract BibTeX arXiv:2312.08468

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Making Multi-agent Reinforcement Learning

Multi-Agent Diagnostics for Robustness via Illuminated Diversity

2024-01-24 · Mikayel Samvelyan, Davide Paglieri, Minqi Jiang, Jack Parker-Holder 외

In the rapidly advancing field of multi-agent systems, ensuring robustness in unfamiliar and adversarial settings is crucial. Notwithstanding their outstanding performance in familiar environments, these systems often fa…

Decision Making Diversity Multi-agent Reinforcement Learning

Probing Dec-POMDP Reasoning in Cooperative MARL

2026-02-24 · Kale-ab Tessera, Leonard Hinckeldey, Riccardo Zamboni, David Abel 외 arxiv

Cooperative multi-agent reinforcement learning (MARL) is typically framed as a decentralised partially observable Markov decision process (Dec-POMDP), a setting whose hardness stems from two key challenges: partial obser…

Multi-agent Reinforcement Learning

Behaviour-conditioned policies for cooperative reinforcement learning tasks

2021-10-04 · Antti Keurulainen, Isak Westerlund, Ariel Kwiatkowski, Samuel Kaski 외

The cooperation among AI systems, and between AI systems and humans is becoming increasingly important. In various real-world tasks, an agent needs to cooperate with unknown partner agent types. This requires the agent t…

Deep Reinforcement Learning Meta-Learning reinforcement-learning Reinforcement Learning+1

Balancing Rational and Other-Regarding Preferences in Cooperative-Competitive Environments

2021-02-24 · Dmitry Ivanov, Vladimir Egorov, Aleksei Shpilman

Recent reinforcement learning studies extensively explore the interplay between cooperative and competitive behaviour in mixed environments. Unlike cooperative environments where agents strive towards a common goal, mixe…

Multi-agent Reinforcement Learning Q-Learning

Individual-Level Inverse Reinforcement Learning for Mean Field Games

2022-02-13 · Yang Chen, Libo Zhang, Jiamou Liu, Shuyue Hu

The recent mean field game (MFG) formalism has enabled the application of inverse reinforcement learning (IRL) methods in large-scale multi-agent systems, with the goal of inferring reward signals that can explain demons…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)