LESS: Label-Efficient Semantic Segmentation for LiDAR Point Clouds
Semantic segmentation of LiDAR point clouds is an important task in autonomous driving. However, training deep models via conventional supervised methods requires large datasets which are costly to label. It is critical to have label-efficient segmentation approaches to scale up the model to new operational domains or to improve performance on rare cases. While most prior works focus on indoor scenes, we are one of the first to propose a label-efficient semantic segmentation pipeline for outdoor scenes with LiDAR point clouds. Our method co-designs an efficient labeling process with semi/weakly supervised learning and is applicable to nearly any 3D semantic segmentation backbones. Specifically, we leverage geometry patterns in outdoor scenes to have a heuristic pre-segmentation to reduce the manual labeling and jointly design the learning targets with the labeling process. In the learning step, we leverage prototype learning to get more descriptive point embeddings and use multi-scan distillation to exploit richer semantics from temporally aggregated point clouds to boost the performance of single-scan models. Evaluated on the SemanticKITTI and the nuScenes datasets, we show that our proposed method outperforms existing label-efficient methods. With extremely limited human annotations (e.g., 0.1% point labels), our proposed method is even highly competitive compared to the fully supervised counterpart with 100% labels.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Semantic SegmentationAutonomous DrivingDescriptiveSegmentationSemantic SegmentationWeakly-supervised LearningSimilar Papers 제목 키워드 기반
Weakly Supervised LiDAR Semantic Segmentation via Scatter Image Annotation
Weakly supervised LiDAR semantic segmentation has made significant strides with limited labeled data. However, most existing methods focus on the network training under weak supervision, while efficient annotation strate…
Image SegmentationLIDAR Semantic SegmentationOptical Flow EstimationRepresentation Learning+2Multi-modal NeRF Self-Supervision for LiDAR Semantic Segmentation
LiDAR Semantic Segmentation is a fundamental task in autonomous driving perception consisting of associating each LiDAR point to a semantic label. Fully-supervised models have widely tackled this task, but they require l…
Autonomous DrivingDomain AdaptationLIDAR Semantic SegmentationNeRF+1Complete & Label: A Domain Adaptation Approach to Semantic Segmentation of LiDAR Point Clouds
We study an unsupervised domain adaptation problem for the semantic labeling of 3D point clouds, with a particular focus on domain discrepancies induced by different LiDAR sensors. Based on the observation that sparse 3D…
Domain AdaptationSemantic SegmentationUnsupervised Domain Adaptation3D Can Be Explored In 2D: Pseudo-Label Generation for LiDAR Point Clouds Using Sensor-Intensity-Based 2D Semantic Segmentation
Semantic segmentation of 3D LiDAR point clouds, essential for autonomous driving and infrastructure management, is best achieved by supervised learning, which demands extensive annotated datasets and faces the problem of…
2D Semantic Segmentation3D Semantic SegmentationAutonomous DrivingDomain Adaptation+4A Benchmark for LiDAR-based Panoptic Segmentation based on KITTI
Panoptic segmentation is the recently introduced task that tackles semantic segmentation and instance segmentation jointly. In this paper, we present an extension of SemanticKITTI, which is a large-scale dataset providin…
Instance SegmentationPanoptic SegmentationSegmentationSemantic Segmentation