Recursive Reasoning Graph for Multi-Agent Reinforcement Learning

2022-03-06 · Xiaobai Ma, David Isele, Jayesh K. Gupta, Kikuo Fujimura, Mykel J. Kochenderfer

Multi-agent reinforcement learning (MARL) provides an efficient way for simultaneously learning policies for multiple agents interacting with each other. However, in scenarios requiring complex interactions, existing algorithms can suffer from an inability to accurately anticipate the influence of self-actions on other agents. Incorporating an ability to reason about other agents' potential responses can allow an agent to formulate more effective strategies. This paper adopts a recursive reasoning model in a centralized-training-decentralized-execution framework to help learning agents better cooperate with or compete against others. The proposed algorithm, referred to as the Recursive Reasoning Graph (R2G), shows state-of-the-art performance on multiple multi-agent particle and robotics games.

📄 PDF Abstract BibTeX arXiv:2203.02844

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Probabilistic Recursive Reasoning for Multi-Agent Reinforcement Learning

2019-01-26 · ICLR 2019 5 · Ying Wen, Yaodong Yang, Rui Luo, Jun Wang 외

Humans are capable of attributing latent mental contents such as beliefs or intentions to others. The social skill is critical in daily life for reasoning about the potential consequences of others' behaviors so as to pl…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

R2-B2: Recursive Reasoning-Based Bayesian Optimization for No-Regret Learning in Games

2020-06-30 · ICML 2020 1 · Zhongxiang Dai, Yizhou Chen, Kian Hsiang Low, Patrick Jaillet 외

This paper presents a recursive reasoning formalism of Bayesian optimization (BO) to model the reasoning process in the interactions between boundedly rational, self-interested agents with unknown, complex, and costly-to…

Bayesian Optimization Multi-agent Reinforcement Learning

PRefLexOR: Preference-based Recursive Language Modeling for Exploratory Optimization of Reasoning and Agentic Thinking

2024-10-16 · Markus J. Buehler

PRefLexOR (Preference-based Recursive Language Modeling for Exploratory Optimization of Reasoning) combines preference optimization with concepts from Reinforcement Learning to enable models to self-teach through iterati…

Language Modeling Language Modelling Multi-agent Integration

Modelling Bounded Rationality in Multi-Agent Interactions by Generalized Recursive Reasoning

2019-01-26 · Ying Wen, Yaodong Yang, Rui Luo, Jun Wang

Though limited in real-world decision making, most multi-agent reinforcement learning (MARL) models assume perfectly rational agents -- a property hardly met due to individual's cognitive limitation and/or the tractabili…

Decision Making Multi-agent Reinforcement Learning Reinforcement Learning

Hierarchical Reinforcement Learning for Zero-shot Generalization with Subtask Dependencies

2018-07-19 · NeurIPS 2018 12 · Sungryull Sohn, Junhyuk Oh, Honglak Lee

We introduce a new RL problem where the agent is required to generalize to a previously-unseen environment characterized by a subtask graph which describes a set of subtasks and their dependencies. Unlike existing hierar…

Hierarchical Reinforcement Learning Network Embedding reinforcement-learning Reinforcement Learning+2