Multi-agent rendezvous in fluid flows via reinforcement learning

2026-06-09 · Bocheng Li, Jingran Qiu, Lihao Zhao arxiv

Rendezvous is a critical task for multi-agent systems, requiring agents to coordinate to meet at an unspecified location. However, achieving this in fluid environments presents a challenge, as it remains unclear how agents can exploit underlying fluid kinematics to facilitate convergence. In this study, we adopt a multi-agent reinforcement learning (MARL) approach to develop physics-informed rendezvous strategies in vortical flows. Compared to a naive strategy, where agents navigate toward their counterparts, MARL strategies significantly improve the rendezvous rate. MARL strategies also show transferability across varying vortex intensities, vortex scales, and swarm sizes. By breaking the symmetry of the state-action map, MARL strategy leverages a non-intuitive mechanism that prevents agents from becoming trapped in separate vortices, thereby enhancing rendezvous success. Additionally, a heuristic strategy is extracted from the learned strategy and also outperforms the naive strategy. Furthermore, a theoretical analysis demonstrates that fluid deformation impedes the rendezvous process. Large finite-time Lyapunov exponents identify where fluid effects separate adjacent agents, suggesting that targets should be planned in weak-deformation regions. Our findings reveal the important role that agent-fluid interactions play in multi-agent tasks and highlight the MARL capability to explore swarm intelligence in complex flow environments.

📄 PDF Abstract BibTeX arXiv:2606.11274

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning

Model-based Reinforcement Learning for Decentralized Multiagent Rendezvous

2020-03-15 · Rose E. Wang, J. Chase Kew, Dennis Lee, Tsang-Wei Edward Lee 외

Collaboration requires agents to align their goals on the fly. Underlying the human ability to align goals with other agents is their ability to predict the intentions of others and actively update their own plans. We pr…

model Model-based Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Current state of the multi-agent multi-view experimental and digital twin rendezvous (MMEDR-Autonomous) framework

2026-03-21 · Logan Banker, Michael Wozniak, Mohanad Alameer, Smriti Nandan Paul 외 arxiv

As near-Earth resident space objects proliferate, there is an increasing demand for reliable technologies in applications of on-orbit servicing, debris removal, and orbit modification. Rendezvous and docking are critical…

Reinforcement Learning Pose Estimation

A Reinforcement Learning Approach for the Multichannel Rendezvous Problem

2019-07-02 · Jen-Hung Wang, Ping-En Lu, Cheng-Shang Chang, Duan-Shin Lee

In this paper, we consider the multichannel rendezvous problem in cognitive radio networks (CRNs) where the probability that two users hopping on the same channel have a successful rendezvous is a function of channel sta…

channel selection reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Optimizing Mission Planning for Multi-Debris Rendezvous Using Reinforcement Learning with Refueling and Adaptive Collision Avoidance

2026-02-04 · Agni Bandyopadhyay, Gunther Waxenegger-Wilfing arxiv

As the orbital environment around Earth becomes increasingly crowded with debris, active debris removal (ADR) missions face significant challenges in ensuring safe operations while minimizing the risk of in-orbit collisi…

Reinforcement Learning Collision Avoidance

A perspective on fluid mechanical environments for challenges in reinforcement learning

2026-05-24 · Shruti Mishra, Michael Chang, Vamsi Spandan, Shmuel M. Rubinstein arxiv

We consider the challenge of developing agents that efficiently interact with high-dimensional, evolving environments, towards a view of practical reinforcement learning (RL) agents interacting with open worlds, of which…

Reinforcement Learning