A Task-Efficient Reinforcement Learning Task-Motion Planner for Safe Human-Robot Cooperation
In a Human-Robot Cooperation (HRC) environment, safety and efficiency are the two core properties to evaluate robot performance. However, safety mechanisms usually hinder task efficiency since human intervention will cause backup motions and goal failures of the robot. Frequent motion replanning will increase the computational load and the chance of failure. In this paper, we present a hybrid Reinforcement Learning (RL) planning framework which is comprised of an interactive motion planner and a RL task planner. The RL task planner attempts to choose statistically safe and efficient task sequences based on the feedback from the motion planner, while the motion planner keeps the task execution process collision-free by detecting human arm motions and deploying new paths when the previous path is not valid anymore. Intuitively, the RL agent will learn to avoid dangerous tasks, while the motion planner ensures that the chosen tasks are safe. The proposed framework is validated on the cobot in both simulation and the real world, we compare the planner with hard-coded task motion planning methods. The results show that our planning framework can 1) react to uncertain human motions at both joint and task levels; 2) reduce the times of repeating failed goal commands; 3) reduce the total number of replanning requests.
Code (0)
등록된 구현이 없습니다.
Tasks
Reinforcement LearningMotion PlanningSimilar Papers 제목 키워드 기반
Motion Planner Augmented Reinforcement Learning for Robot Manipulation in Obstructed Environments
Deep reinforcement learning (RL) agents are able to learn contact-rich manipulation tasks by maximizing a reward signal, but require large amounts of experience, especially in environments with many obstacles that compli…
Contact-rich ManipulationDeep Reinforcement Learningreinforcement-learningReinforcement Learning (RL)+1CorrectionPlanner: Self-Correction Planner with Reinforcement Learning in Autonomous Driving
Autonomous driving requires safe planning, but most learning-based planners lack explicit self-correction ability: once an unsafe action is proposed, there is no mechanism to correct it. Thus, we propose CorrectionPlanne…
Reinforcement LearningAutonomous DrivingCRASH: Challenging Reinforcement-Learning Based Adversarial Scenarios For Safety Hardening
Ensuring the safety of autonomous vehicles (AVs) requires identifying rare but critical failure cases that on-road testing alone cannot discover. High-fidelity simulations provide a scalable alternative, but automaticall…
Autonomous VehiclesDeep Reinforcement Learningreinforcement-learningReinforcement LearningSafe multi-agent motion planning under uncertainty for drones using filtered reinforcement learning
We consider the problem of safe multi-agent motion planning for drones in uncertain, cluttered workspaces. For this problem, we present a tractable motion planner that builds upon the strengths of reinforcement learning …
Collision AvoidanceMotion Planningreinforcement-learningReinforcement Learning+1Integrated Task and Motion Planning for Safe Legged Navigation in Partially Observable Environments
This study proposes a hierarchically integrated framework for safe task and motion planning (TAMP) of bipedal locomotion in a partially observable environment with dynamic obstacles and uneven terrain. The high-level tas…
Motion PlanningTask and Motion Planning