Robot Trajectron: Trajectory Prediction-based Shared Control for Robot Manipulation
We address the problem of (a) predicting the trajectory of an arm reaching motion, based on a few seconds of the motion's onset, and (b) leveraging this predictor to facilitate shared-control manipulation tasks, easing the cognitive load of the operator by assisting them in their anticipated direction of motion. Our novel intent estimator, dubbed the \emph{Robot Trajectron} (RT), produces a probabilistic representation of the robot's anticipated trajectory based on its recent position, velocity and acceleration history. Taking arm dynamics into account allows RT to capture the operator's intent better than other SOTA models that only use the arm's position, making it particularly well-suited to assist in tasks where the operator's intent is susceptible to change. We derive a novel shared-control solution that combines RT's predictive capacity to a representation of the locations of potential reaching targets. Our experiments demonstrate RT's effectiveness in both intent estimation and shared-control tasks. We will make the code and data supporting our experiments publicly available at https://github.com/mousecpn/Robot-Trajectron.git.
Code (1)
Tasks
PositionRobot ManipulationTrajectory PredictionSimilar Papers 제목 키워드 기반
Trajectron++: Dynamically-Feasible Trajectory Forecasting With Heterogeneous Data
Reasoning about human motion is an important prerequisite to safe and socially-aware robotic navigation. As a result, multi-agent behavior prediction has become a core component of modern human-robot interactive systems,…
Motion ForecastingSelf-Driving CarsTrajectory ForecastingTrajectory PredictionRobot Trajectron V3: A Probabilistic Shared Control Framework for SE(3) Manipulation
We aim to address the challenge of teleoperating robotic arms for high-degree-of-freedom (high-DoF) manipulation tasks, which is cognitively demanding and error-prone, particularly when relying on low-bandwidth interface…
Trajectory PredictionBayesian InferencePoint CloudsRobot Trajectron V2: A Probabilistic Shared Control Framework for Navigation
We propose a probabilistic shared-control solution for navigation, called Robot Trajectron V2 (RT-V2), that enables accurate intent prediction and safe, effective assistance in human-robot interaction. RT-V2 jointly mode…
Reinforcement LearningRisk-Sensitive Sequential Action Control with Multi-Modal Human Trajectory Forecasting for Safe Crowd-Robot Interaction
This paper presents a novel online framework for safe crowd-robot interaction based on risk-sensitive stochastic optimal control, wherein the risk is modeled by the entropic risk measure. The sampling-based model predict…
Model Predictive ControlTrajectory ForecastingSmooth-Trajectron++: Augmenting the Trajectron++ behaviour prediction model with smooth attention
Understanding traffic participants' behaviour is crucial for predicting their future trajectories, aiding in developing safe and reliable planning systems for autonomous vehicles. Integrating cognitive processes and mach…
Autonomous DrivingAutonomous VehiclesTrajectory ForecastingTrajectory Prediction