Causal Multi-Agent Reinforcement Learning: Review and Open Problems

2021-11-12 · St John Grimbly, Jonathan Shock, Arnu Pretorius

This paper serves to introduce the reader to the field of multi-agent reinforcement learning (MARL) and its intersection with methods from the study of causality. We highlight key challenges in MARL and discuss these in the context of how causal methods may assist in tackling them. We promote moving toward a 'causality first' perspective on MARL. Specifically, we argue that causality can offer improved safety, interpretability, and robustness, while also providing strong theoretical guarantees for emergent behaviour. We discuss potential solutions for common challenges, and use this context to motivate future research directions.

📄 PDF Abstract BibTeX arXiv:2111.06721

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Causal Reinforcement Learning: A Survey

2023-07-04 · Zhihong Deng, Jing Jiang, Guodong Long, Chengqi Zhang

Reinforcement learning is an essential paradigm for solving sequential decision problems under uncertainty. Despite many remarkable achievements in recent decades, applying reinforcement learning methods in the real worl…

reinforcement-learning Reinforcement Learning Survey Transfer Learning

Can Active Sampling Reduce Causal Confusion in Offline Reinforcement Learning?

2023-12-28 · Gunshi Gupta, Tim G. J. Rudner, Rowan Thomas McAllister, Adrien Gaidon 외

Causal confusion is a phenomenon where an agent learns a policy that reflects imperfect spurious correlations in the data. Such a policy may falsely appear to be optimal during training if most of the training data conta…

reinforcement-learning Reinforcement Learning

A Survey on Causal Reinforcement Learning

2023-02-10 · Yan Zeng, Ruichu Cai, Fuchun Sun, Libo Huang 외

While Reinforcement Learning (RL) achieves tremendous success in sequential decision-making problems of many domains, it still faces key challenges of data inefficiency and the lack of interpretability. Interestingly, ma…

Decision Making reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+2

Causal Machine Learning: A Survey and Open Problems

2022-06-30 · Jean Kaddour, Aengus Lynch, Qi Liu, Matt J. Kusner 외

Causal Machine Learning (CausalML) is an umbrella term for machine learning methods that formalize the data-generation process as a structural causal model (SCM). This perspective enables us to reason about the effects o…

BIG-bench Machine Learning Fairness Graph Representation Learning Representation Learning+1

Causal MAS: A Survey of Large Language Model Architectures for Discovery and Effect Estimation

2025-08-31 · Adib Bazgir, Amir Habibdoust, Yuwen Zhang, Xing Song arxiv

Large Language Models (LLMs) have demonstrated remarkable capabilities in various reasoning and generation tasks. However, their proficiency in complex causal reasoning, discovery, and estimation remains an area of activ…