paper-with-me

Papers

Distributed Heuristic Multi-Agent Path Finding with Communication

2021-06-21 · Ziyuan Ma, Yudong Luo, Hang Ma

Multi-Agent Path Finding (MAPF) is essential to large-scale robotic systems. Recent methods have applied reinforcement learning (RL) to learn decentralized polices in partially observable environments. A fundamental challenge of obtaining collision-free policy is that agents need to learn cooperation to handle congested situations. This paper combines communication with deep Q-learning to provide a novel learning based method for MAPF, where agents achieve cooperation via graph convolution. To guide RL algorithm on long-horizon goal-oriented tasks, we embed the potential choices of shortest paths from single source as heuristic guidance instead of using a specific path as in most existing works. Our method treats each agent independently and trains the model from a single agent's perspective. The final trained policy is applied to each agent for decentralized execution. The whole system is distributed during training and is trained under a curriculum learning strategy. Empirical evaluation in obstacle-rich environment indicates the high success rate with low average step of our method.

📄 PDF Abstract BibTeX arXiv:2106.11365

Code (1)

ZiyuanMa/DHC 공식 구현 pytorch

Tasks

Multi-Agent Path FindingQ-LearningReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Similar Papers 제목 키워드 기반

Heuristically Guided Compilation for Multi-Agent Path Finding

2022-12-13 · Pavel Surynek

Multi-agent path finding (MAPF) is a task of finding non-conflicting paths connecting agents' specified initial and goal positions in a shared environment. We focus on compilation-based solvers in which the MAPF problem …

Multi-Agent Path Finding

PC2P: Multi-Agent Path Finding via Personalized-Enhanced Communication and Crowd Perception

2026-01-06 · Guotao Li, Shaoyun Xu, Yuexing Hao, Yang Wang 외 arxiv

Distributed Multi-Agent Path Finding (MAPF) integrated with Multi-Agent Reinforcement Learning (MARL) has emerged as a prominent research focus, enabling real-time cooperative decision-making in partially observable envi…

Multi-agent Reinforcement Learning

Anytime Multi-Agent Path Finding with an Adaptive Delay-Based Heuristic

2024-08-06 · Thomy Phan, Benran Zhang, Shao-Hung Chan, Sven Koenig

Anytime multi-agent path finding (MAPF) is a promising approach to scalable path optimization in multi-agent systems. MAPF-LNS, based on Large Neighborhood Search (LNS), is the current state-of-the-art approach where a f…

Multi-Agent Path FindingSelf-LearningThompson Sampling

HiMAP: Learning Heuristics-Informed Policies for Large-Scale Multi-Agent Pathfinding

2024-02-23 · Huijie Tang, Federico Berto, Zihan Ma, Chuanbo Hua 외

Large-scale multi-agent pathfinding (MAPF) presents significant challenges in several areas. As systems grow in complexity with a multitude of autonomous agents operating simultaneously, efficient and collision-free coor…

Imitation LearningReinforcement Learning (RL)

MAPF-HD: Multi-Agent Path Finding in High-Density Environments

2025-09-08 · Hiroya Makino, Seigo Ito arxiv

Multi-agent path finding (MAPF) involves planning efficient paths for multiple agents to move simultaneously while avoiding collisions. In typical warehouse environments, agents are often sparsely distributed along aisle…