Bootstrap Motion Forecasting With Self-Consistent Constraints
We present a novel framework to bootstrap Motion forecasting with Self-consistent Constraints (MISC). The motion forecasting task aims at predicting future trajectories of vehicles by incorporating spatial and temporal information from the past. A key design of MISC is the proposed Dual Consistency Constraints that regularize the predicted trajectories under spatial and temporal perturbation during training. Also, to model the multi-modality in motion forecasting, we design a novel self-ensembling scheme to obtain accurate teacher targets to enforce the self-constraints with multi-modality supervision. With explicit constraints from multiple teacher targets, we observe a clear improvement in the prediction performance. Extensive experiments on the Argoverse motion forecasting benchmark and Waymo Open Motion dataset show that MISC significantly outperforms the state-of-the-art methods. As the proposed strategies are general and can be easily incorporated into other motion forecasting approaches, we also demonstrate that our proposed scheme consistently improves the prediction performance of several existing methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Motion ForecastingSimilar Papers 제목 키워드 기반
Scene-aware Human Motion Forecasting via Mutual Distance Prediction
In this paper, we tackle the problem of scene-aware 3D human motion forecasting. A key challenge of this task is to predict future human motions that are consistent with the scene by modeling the human-scene interactions…
Human Pose ForecastingMotion ForecastingMotion Forecasting in Continuous Driving
Motion forecasting for agents in autonomous driving is highly challenging due to the numerous possibilities for each agent's next action and their complex interactions in space and time. In real applications, motion fore…
Autonomous DrivingMotion ForecastingPose Constraints for Consistent Self-supervised Monocular Depth and Ego-motion
Self-supervised monocular depth estimation approaches suffer not only from scale ambiguity but also infer temporally inconsistent depth maps w.r.t. scale. While disambiguating scale during training is not possible withou…
Camera Pose EstimationDepth EstimationEgocentric Pose EstimationMonocular Depth Estimation+2SSL-Lanes: Self-Supervised Learning for Motion Forecasting in Autonomous Driving
Self-supervised learning (SSL) is an emerging technique that has been successfully employed to train convolutional neural networks (CNNs) and graph neural networks (GNNs) for more transferable, generalizable, and robust …
Autonomous DrivingMotion ForecastingRepresentation LearningSelf-Supervised LearningThe Importance of Prior Knowledge in Precise Multimodal Prediction
Roads have well defined geometries, topologies, and traffic rules. While this has been widely exploited in motion planning methods to produce maneuvers that obey the law, little work has been devoted to utilize these pri…
Motion ForecastingMotion Planning