A Roadmap Towards Improving Multi-Agent Reinforcement Learning With Causal Discovery And Inference
Causal reasoning is increasingly used in Reinforcement Learning (RL) to improve the learning process in several dimensions: efficacy of learned policies, efficiency of convergence, generalisation capabilities, safety and interpretability of behaviour. However, applications of causal reasoning to Multi-Agent RL (MARL) are still mostly unexplored. In this paper, we take the first step in investigating the opportunities and challenges of applying causal reasoning in MARL. We measure the impact of a simple form of causal augmentation in state-of-the-art MARL scenarios increasingly requiring cooperation, and with state-of-the-art MARL algorithms exploiting various degrees of collaboration between agents. Then, we discuss the positive as well as negative results achieved, giving us the chance to outline the areas where further research may help to successfully transfer causal RL to the multi-agent setting.
Code (0)
등록된 구현이 없습니다.
Tasks
Causal DiscoveryMulti-agent Reinforcement LearningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
A Review and Roadmap of Deep Learning Causal Discovery in Different Variable Paradigms
Understanding causality helps to structure interventions to achieve specific goals and enables predictions under interventions. With the growing importance of learning causal relationships, causal discovery tasks have tr…
Causal DiscoveryScientific Hypothesis Generation and Validation: Methods, Datasets, and Future Directions
Large Language Models (LLMs) are transforming scientific hypothesis generation and validation by enabling information synthesis, latent relationship discovery, and reasoning augmentation. This survey provides a structure…
Causal InferenceDomain AdaptationIn-Context LearningKnowledge Graph Completion+5Goal Discovery with Causal Capacity for Efficient Reinforcement Learning
Causal inference is crucial for humans to explore the world, which can be modeled to enable an agent to efficiently explore the environment in reinforcement learning. Existing research indicates that establishing the cau…
Reinforcement LearningCausal InferenceCausal Process Models: Reframing Dynamic Causal Graph Discovery as a Reinforcement Learning Problem
Most neural models of causality assume static causal graphs, failing to capture the dynamic and sparse nature of physical interactions where causal relationships emerge and dissolve over time. We introduce the Causal Pro…
Multi-agent Reinforcement LearningComputational EfficiencyDiscovering Causality for Efficient Cooperation in Multi-Agent Environments
In cooperative Multi-Agent Reinforcement Learning (MARL) agents are required to learn behaviours as a team to achieve a common goal. However, while learning a task, some agents may end up learning sub-optimal policies, n…
Causal DiscoveryMulti-agent Reinforcement Learning