GenAD: Generalized Predictive Model for Autonomous Driving
In this paper, we introduce the first large-scale video prediction model in the autonomous driving discipline. To eliminate the restriction of high-cost data collection and empower the generalization ability of our model, we acquire massive data from the web and pair it with diverse and high-quality text descriptions. The resultant dataset accumulates over 2000 hours of driving videos, spanning areas all over the world with diverse weather conditions and traffic scenarios. Inheriting the merits from recent latent diffusion models, our model, dubbed GenAD, handles the challenging dynamics in driving scenes with novel temporal reasoning blocks. We showcase that it can generalize to various unseen driving datasets in a zero-shot manner, surpassing general or driving-specific video prediction counterparts. Furthermore, GenAD can be adapted into an action-conditioned prediction model or a motion planner, holding great potential for real-world driving applications.
Code (3)
Tasks
Autonomous DrivingmodelPredictionVideo PredictionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
GenAD: Generative End-to-End Autonomous Driving
Directly producing planning results from raw sensors has been a long-desired solution for autonomous driving and has attracted increasing attention recently. Most existing end-to-end autonomous driving methods factorize …
Autonomous DrivingBench2Drivemotion predictionCan Attribution Predict Risk? From Multi-View Attribution to Planning Risk Signals in End-to-End Autonomous Driving
End-to-end autonomous driving models generate future trajectories from multi-view inputs, improving system integration but introducing opaque decisions and hard-to-localize risks. Existing methods either rely on auxiliar…
Image ClassificationAutonomous DrivingGenAD: General Representations of Multivariate Time Series for Anomaly Detection
Anomaly Detection(AD) for multivariate time series is an active area in machine learning, with critical applications in Information Technology system management, Spacecraft Health monitoring, Multi-Robot Systems detectio…
Anomaly DetectionManagementTime SeriesTime Series Analysis+1DarkDriving: A Real-World Day and Night Aligned Dataset for Autonomous Driving in the Dark Environment
The low-light conditions are challenging to the vision-centric perception systems for autonomous driving in the dark environment. In this paper, we propose a new benchmark dataset (named DarkDriving) to investigate the l…
Autonomous DrivingRNN-based linear parameter varying adaptive model predictive control for autonomous driving
Autonomous driving is a complex and highly dynamic process that ensures controlling the coupled longitudinal and lateral vehicle dynamics. Model predictive control, distinguished by its predictive feature, optimal perfor…
Autonomous DrivingModel Predictive Control