paper-with-me

Papers

Zonal RL-RRT: Integrated RL-RRT Path Planning with Collision Probability and Zone Connectivity

2024-10-31 · AmirMohammad Tahmasbi, MohammadSaleh Faghfoorian, Saeed Khodaygan, Aniket Bera

Path planning in high-dimensional spaces poses significant challenges, particularly in achieving both time efficiency and a fair success rate. To address these issues, we introduce a novel path-planning algorithm, Zonal RL-RRT, that leverages kd-tree partitioning to segment the map into zones while addressing zone connectivity, ensuring seamless transitions between zones. By breaking down the complex environment into multiple zones and using Q-learning as the high-level decision-maker, our algorithm achieves a 3x improvement in time efficiency compared to basic sampling methods such as RRT and RRT* in forest-like maps. Our approach outperforms heuristic-guided methods like BIT* and Informed RRT* by 1.5x in terms of runtime while maintaining robust and reliable success rates across 2D to 6D environments. Compared to learning-based methods like NeuralRRT* and MPNetSMP, as well as the heuristic RRT*J, our algorithm demonstrates, on average, 1.5x better performance in the same environments. We also evaluate the effectiveness of our approach through simulations of the UR10e arm manipulator in the MuJoCo environment. A key observation of our approach lies in its use of zone partitioning and Reinforcement Learning (RL) for adaptive high-level planning allowing the algorithm to accommodate flexible policies across diverse environments, making it a versatile tool for advanced path planning.

📄 PDF Abstract BibTeX arXiv:2410.24205

Code (1)

saleh-faghfoorian/rl-rrt-kdtree 공식 구현

Tasks

MuJoCoQ-LearningReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Similar Papers 제목 키워드 기반

Safe and Efficient Path Planning under Uncertainty via Deep Collision Probability Fields

2024-09-06 · Felix Herrmann, Sebastian Zach, Jacopo Banfi, Jan Peters 외

Estimating collision probabilities between robots and environmental obstacles or other moving agents is crucial to ensure safety during path planning. This is an important building block of modern planning algorithms in …

Autonomous Driving

Optimal Integrated Task and Path Planning and Its Application to Multi-Robot Pickup and Delivery

2024-03-02 · Aman Aryan, Manan Modi, Indranil Saha, Rupak Majumdar 외

We propose a generic multi-robot planning mechanism that combines an optimal task planner and an optimal path planner to provide a scalable solution for complex multi-robot planning problems. The Integrated planner, thro…

Task Planning

Cooperative Multi-Agent Path Finding: Beyond Path Planning and Collision Avoidance

2021-05-23 · Nir Greshler, Ofir Gordon, Oren Salzman, Nahum Shimkin

We introduce the Cooperative Multi-Agent Path Finding (Co-MAPF) problem, an extension to the classical MAPF problem, where cooperative behavior is incorporated. In this setting, a group of autonomous agents operate in a …

Collision AvoidanceMulti-Agent Path Finding

Forecast-Driven MPC for Decentralized Multi-Robot Collision Avoidance

2025-07-25 · Hadush Hailu, Bruk Gebregziabher, Prudhvi Raj arxiv

The Iterative Forecast Planner (IFP) is a geometric planning approach that offers lightweight computations, scalable, and reactive solutions for multi-robot path planning in decentralized, communication-free settings. Ho…

Collision Avoidance

SafePath: Conformal Prediction for Safe LLM-Based Autonomous Navigation

2025-05-14 · Achref Doula, Max Mühlhäuser, Alejandro Sanchez Guinea

Large Language Models (LLMs) show growing promise in autonomous driving by reasoning over complex traffic scenarios to generate path plans. However, their tendencies toward overconfidence, and hallucinations raise critic…

Autonomous DrivingAutonomous NavigationConformal PredictionMultiple-choice+1