Self-Supervised Class-Agnostic Motion Prediction with Spatial and Temporal Consistency Regularizations
The perception of motion behavior in a dynamic environment holds significant importance for autonomous driving systems, wherein class-agnostic motion prediction methods directly predict the motion of the entire point cloud. While most existing methods rely on fully-supervised learning, the manual labeling of point cloud data is laborious and time-consuming. Therefore, several annotation-efficient methods have been proposed to address this challenge. Although effective, these methods rely on weak annotations or additional multi-modal data like images, and the potential benefits inherent in the point cloud sequence are still underexplored. To this end, we explore the feasibility of self-supervised motion prediction with only unlabeled LiDAR point clouds. Initially, we employ an optimal transport solver to establish coarse correspondences between current and future point clouds as the coarse pseudo motion labels. Training models directly using such coarse labels leads to noticeable spatial and temporal prediction inconsistencies. To mitigate these issues, we introduce three simple spatial and temporal regularization losses, which facilitate the self-supervised training process effectively. Experimental results demonstrate the significant superiority of our approach over the state-of-the-art self-supervised methods.
Code (1)
Tasks
Autonomous Drivingmotion predictionPredictionSimilar Papers 제목 키워드 기반
Weakly and Self-Supervised Class-Agnostic Motion Prediction for Autonomous Driving
Understanding motion in dynamic environments is critical for autonomous driving, thereby motivating research on class-agnostic motion prediction. In this work, we investigate weakly and self-supervised class-agnostic mot…
Self-Supervised LearningAutonomous DrivingScene ParsingPoint CloudsWeakly Supervised Class-Agnostic Motion Prediction for Autonomous Driving
Understanding the motion behavior of dynamic environments is vital for autonomous driving, leading to increasing attention in class-agnostic motion prediction in LiDAR point clouds. Outdoor scenes can often be decomp…
Autonomous Drivingmotion predictionPredictionScene Parsing+1Semi-Supervised Class-Agnostic Motion Prediction with Pseudo Label Regeneration and BEVMix
Class-agnostic motion prediction methods aim to comprehend motion within open-world scenarios, holding significance for autonomous driving systems. However, training a high-performance model in a fully-supervised manner …
Autonomous DrivingData Augmentationmotion predictionPseudo LabelSelf-Supervised 3D Scene Flow Estimation and Motion Prediction using Local Rigidity Prior
In this article, we investigate self-supervised 3D scene flow estimation and class-agnostic motion prediction on point clouds. A realistic scene can be well modeled as a collection of rigidly moving parts, therefore its …
Motion Estimationmotion predictionScene Flow EstimationSelf-Supervised LearningSelf-Supervised Pillar Motion Learning for Autonomous Driving
Autonomous driving can benefit from motion behavior comprehension when interacting with diverse traffic participants in highly dynamic environments. Recently, there has been a growing interest in estimating class-agnosti…
Autonomous DrivingMotion Estimation