paper-with-me

Papers

Experience-Based Heuristic Search: Robust Motion Planning with Deep Q-Learning

2021-02-05 · Julian Bernhard, Robert Gieselmann, Klemens Esterle, Alois Knoll

Interaction-aware planning for autonomous driving requires an exploration of a combinatorial solution space when using conventional search- or optimization-based motion planners. With Deep Reinforcement Learning, optimal driving strategies for such problems can be derived also for higher-dimensional problems. However, these methods guarantee optimality of the resulting policy only in a statistical sense, which impedes their usage in safety critical systems, such as autonomous vehicles. Thus, we propose the Experience-Based-Heuristic-Search algorithm, which overcomes the statistical failure rate of a Deep-reinforcement-learning-based planner and still benefits computationally from the pre-learned optimal policy. Specifically, we show how experiences in the form of a Deep Q-Network can be integrated as heuristic into a heuristic search algorithm. We benchmark our algorithm in the field of path planning in semi-structured valet parking scenarios. There, we analyze the accuracy of such estimates and demonstrate the computational advantages and robustness of our method. Our method may encourage further investigation of the applicability of reinforcement-learning-based planning in the field of self-driving vehicles.

📄 PDF Abstract BibTeX arXiv:2102.03127

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingAutonomous VehiclesDeep Reinforcement LearningHeuristic SearchMotion PlanningQ-Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

Representation, learning, and planning algorithms for geometric task and motion planning

2022-03-09 · Beomjoon Kim, Luke Shimanuki, Leslie Pack Kaelbling, Tomás Lozano-Pérez

We present a framework for learning to guide geometric task and motion planning (GTAMP). GTAMP is a subclass of task and motion planning in which the goal is to move multiple objects to target regions among movable obsta…

Heuristic SearchMotion PlanningRepresentation LearningTask and Motion Planning

Context-Aware Behavior Learning with Heuristic Motion Memory for Underwater Manipulation

2025-07-18 · Markus Buchholz, Ignacio Carlucho, Michele Grimaldi, Maria Koskinopoulou 외 arxiv

Autonomous motion planning is critical for efficient and safe underwater manipulation in dynamic marine environments. Current motion planning methods often fail to effectively utilize prior motion experiences and adapt t…

Motion Planning

IBBT: Informed Batch Belief Trees for Motion Planning Under Uncertainty

2023-04-21 · Dongliang Zheng, Panagiotis Tsiotras

In this work, we propose the Informed Batch Belief Trees (IBBT) algorithm for motion planning under motion and sensing uncertainties. The original stochastic motion planning problem is divided into a deterministic motion…

graph constructionMotion Planning

Leveraging Experience in Lazy Search

2021-10-10 · Mohak Bhardwaj, Sanjiban Choudhury, Byron Boots, Siddhartha Srinivasa

Lazy graph search algorithms are efficient at solving motion planning problems where edge evaluation is the computational bottleneck. These algorithms work by lazily computing the shortest potentially feasible path, eval…

Imitation LearningMotion Planning

A novel approach to model exploration for value function learning

2019-06-06 · Zlatan Ajanovic, Halil Beglerovic, Bakir Lacevic

Planning and Learning are complementary approaches. Planning relies on deliberative reasoning about the current state and sequence of future reachable states to solve the problem. Learning, on the other hand, is focused …