paper-with-me

Papers

Self-Supervised Class-Agnostic Motion Prediction with Spatial and Temporal Consistency Regularizations

2024-03-20 · CVPR 2024 1 · Kewei Wang, Yizheng Wu, Jun Cen, Zhiyu Pan, Xingyi Li, Zhe Wang, Zhiguo Cao, Guosheng Lin

The perception of motion behavior in a dynamic environment holds significant importance for autonomous driving systems, wherein class-agnostic motion prediction methods directly predict the motion of the entire point cloud. While most existing methods rely on fully-supervised learning, the manual labeling of point cloud data is laborious and time-consuming. Therefore, several annotation-efficient methods have been proposed to address this challenge. Although effective, these methods rely on weak annotations or additional multi-modal data like images, and the potential benefits inherent in the point cloud sequence are still underexplored. To this end, we explore the feasibility of self-supervised motion prediction with only unlabeled LiDAR point clouds. Initially, we employ an optimal transport solver to establish coarse correspondences between current and future point clouds as the coarse pseudo motion labels. Training models directly using such coarse labels leads to noticeable spatial and temporal prediction inconsistencies. To mitigate these issues, we introduce three simple spatial and temporal regularization losses, which facilitate the self-supervised training process effectively. Experimental results demonstrate the significant superiority of our approach over the state-of-the-art self-supervised methods.

📄 PDF Abstract BibTeX arXiv:2403.13261

Code (1)

kwwcv/selfmotion 공식 구현 pytorch

Tasks

Autonomous Drivingmotion predictionPrediction

Similar Papers 제목 키워드 기반

Weakly and Self-Supervised Class-Agnostic Motion Prediction for Autonomous Driving

2025-09-16 · Ruibo Li, Hanyu Shi, Zhe Wang, Guosheng Lin arxiv

Understanding motion in dynamic environments is critical for autonomous driving, thereby motivating research on class-agnostic motion prediction. In this work, we investigate weakly and self-supervised class-agnostic mot…

Self-Supervised LearningAutonomous DrivingScene ParsingPoint Clouds

Weakly Supervised Class-Agnostic Motion Prediction for Autonomous Driving

2023-01-01 · CVPR 2023 1 · Ruibo Li, Hanyu Shi, Ziang Fu, Zhe Wang 외

Understanding the motion behavior of dynamic environments is vital for autonomous driving, leading to increasing attention in class-agnostic motion prediction in LiDAR point clouds. Outdoor scenes can often be decomp…

Autonomous Drivingmotion predictionPredictionScene Parsing+1

Semi-Supervised Class-Agnostic Motion Prediction with Pseudo Label Regeneration and BEVMix

2023-12-13 · Kewei Wang, Yizheng Wu, Zhiyu Pan, Xingyi Li 외

Class-agnostic motion prediction methods aim to comprehend motion within open-world scenarios, holding significance for autonomous driving systems. However, training a high-performance model in a fully-supervised manner …

Autonomous DrivingData Augmentationmotion predictionPseudo Label

Self-Supervised 3D Scene Flow Estimation and Motion Prediction using Local Rigidity Prior

2023-10-17 · Ruibo Li, Chi Zhang, Zhe Wang, Chunhua Shen 외

In this article, we investigate self-supervised 3D scene flow estimation and class-agnostic motion prediction on point clouds. A realistic scene can be well modeled as a collection of rigidly moving parts, therefore its …

Motion Estimationmotion predictionScene Flow EstimationSelf-Supervised Learning

Self-Supervised Pillar Motion Learning for Autonomous Driving

2021-04-18 · CVPR 2021 1 · Chenxu Luo, Xiaodong Yang, Alan Yuille

Autonomous driving can benefit from motion behavior comprehension when interacting with diverse traffic participants in highly dynamic environments. Recently, there has been a growing interest in estimating class-agnosti…

Autonomous DrivingMotion Estimation