The Trajectron: Probabilistic Multi-Agent Trajectory Modeling With Dynamic Spatiotemporal Graphs
Developing safe human-robot interaction systems is a necessary step towards the widespread integration of autonomous agents in society. A key component of such systems is the ability to reason about the many potential futures (e.g. trajectories) of other agents in the scene. Towards this end, we present the Trajectron, a graph-structured model that predicts many potential future trajectories of multiple agents simultaneously in both highly dynamic and multimodal scenarios (i.e. where the number of agents in the scene is time-varying and there are many possible highly-distinct futures for each agent). It combines tools from recurrent sequence modeling and variational deep generative modeling to produce a distribution of future trajectories for each agent in a scene. We demonstrate the performance of our model on several datasets, obtaining state-of-the-art results on standard trajectory prediction metrics as well as introducing a new metric for comparing models that output distributions.
Code (1)
Tasks
Decision MakingMotion ForecastingTrajectory ForecastingTrajectory ModelingTrajectory PredictionSimilar Papers 제목 키워드 기반
Trajectron++: Dynamically-Feasible Trajectory Forecasting With Heterogeneous Data
Reasoning about human motion is an important prerequisite to safe and socially-aware robotic navigation. As a result, multi-agent behavior prediction has become a core component of modern human-robot interactive systems,…
Motion ForecastingSelf-Driving CarsTrajectory ForecastingTrajectory PredictionSmooth-Trajectron++: Augmenting the Trajectron++ behaviour prediction model with smooth attention
Understanding traffic participants' behaviour is crucial for predicting their future trajectories, aiding in developing safe and reliable planning systems for autonomous vehicles. Integrating cognitive processes and mach…
Autonomous DrivingAutonomous VehiclesTrajectory ForecastingTrajectory PredictionRobot Trajectron: Trajectory Prediction-based Shared Control for Robot Manipulation
We address the problem of (a) predicting the trajectory of an arm reaching motion, based on a few seconds of the motion's onset, and (b) leveraging this predictor to facilitate shared-control manipulation tasks, easing t…
PositionRobot ManipulationTrajectory PredictionRisk-Sensitive Sequential Action Control with Multi-Modal Human Trajectory Forecasting for Safe Crowd-Robot Interaction
This paper presents a novel online framework for safe crowd-robot interaction based on risk-sensitive stochastic optimal control, wherein the risk is modeled by the entropic risk measure. The sampling-based model predict…
Model Predictive ControlTrajectory ForecastingRobot Trajectron V2: A Probabilistic Shared Control Framework for Navigation
We propose a probabilistic shared-control solution for navigation, called Robot Trajectron V2 (RT-V2), that enables accurate intent prediction and safe, effective assistance in human-robot interaction. RT-V2 jointly mode…
Reinforcement Learning