Exploiting map information for self-supervised learning in motion forecasting
Inspired by recent developments regarding the application of self-supervised learning (SSL), we devise an auxiliary task for trajectory prediction that takes advantage of map-only information such as graph connectivity with the intent of improving map comprehension and generalization. We apply this auxiliary task through two frameworks - multitasking and pretraining. In either framework we observe significant improvement of our baseline in metrics such as $\mathrm{minFDE}_6$ (as much as 20.3%) and $\mathrm{MissRate}_6$ (as much as 33.3%), as well as a richer comprehension of map features demonstrated by different training configurations. The results obtained were consistent in all three data sets used for experiments: Argoverse, Interaction and NuScenes. We also submit our new pretrained model's results to the Interaction challenge and achieve $\textit{1st}$ place with respect to $\mathrm{minFDE}_6$ and $\mathrm{minADE}_6$.
Code (0)
등록된 구현이 없습니다.
Tasks
Motion ForecastingSelf-Supervised LearningTrajectory PredictionSimilar Papers 제목 키워드 기반
Forecasting of depth and ego-motion with transformers and self-supervision
This paper addresses the problem of end-to-end self-supervised forecasting of depth and ego motion. Given a sequence of raw images, the aim is to forecast both the geometry and ego-motion using a self supervised photomet…
Inductive BiasSSL-Lanes: Self-Supervised Learning for Motion Forecasting in Autonomous Driving
Self-supervised learning (SSL) is an emerging technique that has been successfully employed to train convolutional neural networks (CNNs) and graph neural networks (GNNs) for more transferable, generalizable, and robust …
Autonomous DrivingMotion ForecastingRepresentation LearningSelf-Supervised LearningForecast-MAE: Self-supervised Pre-training for Motion Forecasting with Masked Autoencoders
This study explores the application of self-supervised learning (SSL) to the task of motion forecasting, an area that has not yet been extensively investigated despite the widespread success of SSL in computer vision and…
Inductive BiasMotion ForecastingSelf-Supervised LearningMotion Forecasting for Autonomous Vehicles: A Survey
In recent years, the field of autonomous driving has attracted increasingly significant public interest. Accurately forecasting the future behavior of various traffic participants is essential for the decision-making of …
Autonomous DrivingAutonomous VehiclesDecision MakingMotion Forecasting+2Motion Forecasting in Continuous Driving
Motion forecasting for agents in autonomous driving is highly challenging due to the numerous possibilities for each agent's next action and their complex interactions in space and time. In real applications, motion fore…
Autonomous DrivingMotion Forecasting