Self-Supervised Pre-training with Combined Datasets for 3D Perception in Autonomous Driving
The significant achievements of pre-trained models leveraging large volumes of data in the field of NLP and 2D vision inspire us to explore the potential of extensive data pre-training for 3D perception in autonomous driving. Toward this goal, this paper proposes to utilize massive unlabeled data from heterogeneous datasets to pre-train 3D perception models. We introduce a self-supervised pre-training framework that learns effective 3D representations from scratch on unlabeled data, combined with a prompt adapter based domain adaptation strategy to reduce dataset bias. The approach significantly improves model performance on downstream tasks such as 3D object detection, BEV segmentation, 3D object tracking, and occupancy prediction, and shows steady performance increase as the training data volume scales up, demonstrating the potential of continually benefit 3D perception models for autonomous driving. We will release the source code to inspire further investigations in the community.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Object Detection3D Object TrackingAutonomous DrivingBEV SegmentationDomain Adaptationobject-detectionObject DetectionObject TrackingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
SpikeCLR: Contrastive Self-Supervised Learning for Few-Shot Event-Based Vision using Spiking Neural Networks
Event-based vision sensors provide significant advantages for high-speed perception, including microsecond temporal resolution, high dynamic range, and low power consumption. When combined with Spiking Neural Networks (S…
Self-Supervised LearningEvent-based visionLearning Shared RGB-D Fields: Unified Self-supervised Pre-training for Label-efficient LiDAR-Camera 3D Perception
Constructing large-scale labeled datasets for multi-modal perception model training in autonomous driving presents significant challenges. This has motivated the development of self-supervised pretraining strategies. How…
3D Object DetectionAutonomous DrivingNeRFNeural Rendering+4Towards Unsupervised Object Detection From LiDAR Point Clouds
In this paper, we study the problem of unsupervised object detection from 3D point clouds in self-driving scenes. We present a simple yet effective method that exploits (i) point clustering in near-range areas where the …
Objectobject-detectionObject DetectionObject Discovery+1Boosting Supervision with Self-Supervision for Few-shot Learning
We present a technique to improve the transferability of deep representations learned on small labeled datasets by introducing self-supervised tasks as auxiliary loss functions. While recent approaches for self-supervise…
Few-Shot LearningSelf-Supervised LearningSelf-supervised Learning for Sonar Image Classification
Self-supervised learning has proved to be a powerful approach to learn image representations without the need of large labeled datasets. For underwater robotics, it is of great interest to design computer vision algorith…
ClassificationDenoisingimage-classificationImage Classification+2