When Should Agents Coordinate in Differentiable Sequential Decision Problems?

2026-02-03 · Caleb Probine, Su Ann Low, David Fridovich-Keil, Ufuk Topcu arxiv

Multi-robot teams must coordinate to operate effectively. When a team operates in an uncoordinated manner, and agents choose actions that are only individually optimal, the team's outcome can suffer. However, in many domains, coordination requires costly communication. We explore the value of coordination in a broad class of differentiable motion-planning problems. In particular, we model coordinated behavior as a spectrum: at one extreme, agents jointly optimize a common team objective, and at the other, agents make unilaterally optimal decisions given their individual decision variables, i.e., they operate at Nash equilibria. We then demonstrate that reasoning about coordination in differentiable motion-planning problems reduces to reasoning about the second-order properties of agents' objectives, and we provide algorithms that use this second-order reasoning to determine at which times a team of agents should coordinate.

📄 PDF Abstract BibTeX arXiv:2602.03674

Code (0)

등록된 구현이 없습니다.

Sequential Communication in Multi-Agent Reinforcement Learning

2021-09-29 · Ziluo Ding, Weixin Hong, Liwen Zhu, Tiejun Huang 외

Coordination is one of the essential problems in multi-agent reinforcement learning. Communication provides an alternative for agents to obtain information about others so that better coordinated behavior can be learned.…

Decision Making Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Learning to Schedule Communication in Multi-agent Reinforcement Learning

2019-02-05 · ICLR 2019 5 · Daewoo Kim, Sangwoo Moon, David Hostallero, Wan Ju Kang 외

Many real-world reinforcement learning tasks require multiple agents to make sequential decisions under the agents' interaction, where well-coordinated actions among the agents are crucial to achieve the target goal bett…

Deep Reinforcement Learning Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+2

Collaboration of AI Agents via Cooperative Multi-Agent Deep Reinforcement Learning

2019-06-30 · Niranjan Balachandar, Justin Dieter, Govardana Sachithanandam Ramachandran

There are many AI tasks involving multiple interacting agents where agents should learn to cooperate and collaborate to effectively perform the task. Here we develop and evaluate various multi-agent protocols to train ag…

counterfactual Deep Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Relative Interior Rule in Block-Coordinate Minimization

2019-10-21 · Tomáš Werner, Daniel Průša

(Block-)coordinate minimization is an iterative optimization method which in every iteration finds a global minimum of the objective over a variable or a subset of variables, while keeping the remaining variables constan…

Been There, Done That: Meta-Learning with Episodic Recall

2018-05-24 · ICML 2018 7 · Samuel Ritter, Jane. X. Wang, Zeb Kurth-Nelson, Siddhant M. Jayakumar 외

Meta-learning agents excel at rapidly learning new tasks from open-ended task distributions; yet, they forget what they learn about each task as soon as the next begins. When tasks reoccur - as they do in natural environ…

Meta-Learning