Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Dataset
As autonomous driving systems mature, motion forecasting has received increasing attention as a critical requirement for planning. Of particular importance are interactive situations such as merges, unprotected turns, etc., where predicting individual object motion is not sufficient. Joint predictions of multiple objects are required for effective route planning. There has been a critical need for high-quality motion data that is rich in both interactions and annotation to develop motion planning models. In this work, we introduce the most diverse interactive motion dataset to our knowledge, and provide specific labels for interacting objects suitable for developing joint prediction models. With over 100,000 scenes, each 20 seconds long at 10 Hz, our new dataset contains more than 570 hours of unique data over 1750 km of roadways. It was collected by mining for interesting interactions between vehicles, pedestrians, and cyclists across six cities within the United States. We use a high-accuracy 3D auto-labeling system to generate high quality 3D bounding boxes for each road agent, and provide corresponding high definition 3D maps for each scene. Furthermore, we introduce a new set of metrics that provides a comprehensive evaluation of both single agent and joint agent interaction motion forecasting models. Finally, we provide strong baseline models for individual-agent prediction and joint-prediction. We hope that this new large-scale interactive motion dataset will provide new opportunities for advancing motion forecasting models.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingMotion ForecastingMotion PlanningSimilar Papers 제목 키워드 기반
Large Scale Interactive Motion Forecasting for Autonomous Driving: The Waymo Open Motion Dataset
As autonomous driving systems mature, motion forecasting has received increasing attention as a critical requirement for planning. Of particular importance are interactive situations such as merges, unprotected turns…
Autonomous DrivingMotion ForecastingMotion PlanningINT2: Interactive Trajectory Prediction at Intersections
Motion forecasting is an important component in autonomous driving systems. One of the most challenging problems in motion forecasting is interactive trajectory prediction, whose goal is to jointly forecasts the futu…
Autonomous DrivingMotion ForecastingPredictionTrajectory PredictionMATS: An Interpretable Trajectory Forecasting Representation for Planning and Control
Reasoning about human motion is a core component of modern human-robot interactive systems. In particular, one of the main uses of behavior prediction in autonomous systems is to inform robot motion planning and control.…
Autonomous DrivingComputational EfficiencyMotion PlanningTrajectory ForecastingMotionLM: Multi-Agent Motion Forecasting as Language Modeling
Reliable forecasting of the future behavior of road agents is a critical component to safe planning in autonomous vehicles. Here, we represent continuous trajectories as sequences of discrete motion tokens and cast multi…
Autonomous VehiclesLanguage ModelingLanguage ModellingMotion Forecasting+1SIMMF: Semantics-aware Interactive Multiagent Motion Forecasting for Autonomous Vehicle Driving
Autonomous vehicles require motion forecasting of their surrounding multiagents (pedestrians and vehicles) to make optimal decisions for navigation. The existing methods focus on techniques to utilize the positions and v…
Autonomous DrivingAutonomous VehiclesMotion Forecastingmotion prediction