ContrastMotion: Self-supervised Scene Motion Learning for Large-Scale LiDAR Point Clouds
In this paper, we propose a novel self-supervised motion estimator for LiDAR-based autonomous driving via BEV representation. Different from usually adopted self-supervised strategies for data-level structure consistency, we predict scene motion via feature-level consistency between pillars in consecutive frames, which can eliminate the effect caused by noise points and view-changing point clouds in dynamic scenes. Specifically, we propose \textit{Soft Discriminative Loss} that provides the network with more pseudo-supervised signals to learn discriminative and robust features in a contrastive learning manner. We also propose \textit{Gated Multi-frame Fusion} block that learns valid compensation between point cloud frames automatically to enhance feature extraction. Finally, \textit{pillar association} is proposed to predict pillar correspondence probabilities based on feature distance, and whereby further predicts scene motion. Extensive experiments show the effectiveness and superiority of our \textbf{ContrastMotion} on both scene flow and motion prediction tasks. The code is available soon.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingContrastive Learningmotion predictionvalidMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
SLIM: Self-Supervised LiDAR Scene Flow and Motion Segmentation
Recently, several frameworks for self-supervised learning of 3D scene flow on point clouds have emerged. Scene flow inherently separates every scene into multiple moving agents and a large class of points following a…
Motion SegmentationSegmentationSelf-Supervised LearningSelf-Supervised Learning of Non-Rigid Residual Flow and Ego-Motion
Most of the current scene flow methods choose to model scene flow as a per point translation vector without differentiating between static and dynamic components of 3D motion. In this work we present an alternative metho…
Self-Supervised LearningTranslationEMR-MSF: Self-Supervised Recurrent Monocular Scene Flow Exploiting Ego-Motion Rigidity
Self-supervised monocular scene flow estimation, aiming to understand both 3D structures and 3D motions from two temporally consecutive monocular images, has received increasing attention for its simple and economica…
Motion EstimationScene Flow EstimationVisual OdometrySelf-Supervised 3D Scene Flow Estimation and Motion Prediction using Local Rigidity Prior
In this article, we investigate self-supervised 3D scene flow estimation and class-agnostic motion prediction on point clouds. A realistic scene can be well modeled as a collection of rigidly moving parts, therefore its …
Motion Estimationmotion predictionScene Flow EstimationSelf-Supervised LearningJust Go with the Flow: Self-Supervised Scene Flow Estimation
When interacting with highly dynamic environments, scene flow allows autonomous systems to reason about the non-rigid motion of multiple independent objects. This is of particular interest in the field of autonomous driv…
Autonomous DrivingScene Flow EstimationSelf-supervised Scene Flow Estimation