Multi-Space Alignments Towards Universal LiDAR Segmentation
A unified and versatile LiDAR segmentation model with strong robustness and generalizability is desirable for safe autonomous driving perception. This work presents M3Net, a one-of-a-kind framework for fulfilling multi-task, multi-dataset, multi-modality LiDAR segmentation in a universal manner using just a single set of parameters. To better exploit data volume and diversity, we first combine large-scale driving datasets acquired by different types of sensors from diverse scenes and then conduct alignments in three spaces, namely data, feature, and label spaces, during the training. As a result, M3Net is capable of taming heterogeneous data for training state-of-the-art LiDAR segmentation models. Extensive experiments on twelve LiDAR segmentation datasets verify our effectiveness. Notably, using a shared set of parameters, M3Net achieves 75.1%, 83.1%, and 72.4% mIoU scores, respectively, on the official benchmarks of SemanticKITTI, nuScenes, and Waymo Open.
Code (1)
Tasks
Autonomous DrivingDiversitySegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Label-Efficient LiDAR Semantic Segmentation with 2D-3D Vision Transformer Adapters
LiDAR semantic segmentation models are typically trained from random initialization as universal pre-training is hindered by the lack of large, diverse datasets. Moreover, most point cloud segmentation architectures inco…
LIDAR Semantic SegmentationPoint Cloud SegmentationSemantic SegmentationCross-modal & Cross-domain Learning for Unsupervised LiDAR Semantic Segmentation
In recent years, cross-modal domain adaptation has been studied on the paired 2D image and 3D LiDAR data to ease the labeling costs for 3D LiDAR semantic segmentation (3DLSS) in the target domain. However, in such a sett…
Domain AdaptationLIDAR Semantic SegmentationSemantic SegmentationLaserMix for Semi-Supervised LiDAR Semantic Segmentation
Densely annotating LiDAR point clouds is costly, which restrains the scalability of fully-supervised learning methods. In this work, we study the underexplored semi-supervised learning (SSL) in LiDAR segmentation. Our co…
LIDAR Semantic SegmentationSegmentationSemantic SegmentationSemi-Supervised Semantic SegmentationInteractive4D: Interactive 4D LiDAR Segmentation
Interactive segmentation has an important role in facilitating the annotation process of future LiDAR datasets. Existing approaches sequentially segment individual objects at each LiDAR scan, repeating the process throug…
Interactive SegmentationSegmentationAttention-Guided Lidar Segmentation and Odometry Using Image-to-Point Cloud Saliency Transfer
LiDAR odometry estimation and 3D semantic segmentation are crucial for autonomous driving, which has achieved remarkable advances recently. However, these tasks are challenging due to the imbalance of points in different…
3D Semantic SegmentationAutonomous DrivingSegmentationSemantic Segmentation+1