Exploring Scene Affinity for Semi-Supervised LiDAR Semantic Segmentation
This paper explores scene affinity (AIScene), namely intra-scene consistency and inter-scene correlation, for semi-supervised LiDAR semantic segmentation in driving scenes. Adopting teacher-student training, AIScene employs a teacher network to generate pseudo-labeled scenes from unlabeled data, which then supervise the student network's learning. Unlike most methods that include all points in pseudo-labeled scenes for forward propagation but only pseudo-labeled points for backpropagation, AIScene removes points without pseudo-labels, ensuring consistency in both forward and backward propagation within the scene. This simple point erasure strategy effectively prevents unsupervised, semantically ambiguous points (excluded in backpropagation) from affecting the learning of pseudo-labeled points. Moreover, AIScene incorporates patch-based data augmentation, mixing multiple scenes at both scene and instance levels. Compared to existing augmentation techniques that typically perform scene-level mixing between two scenes, our method enhances the semantic diversity of labeled (or pseudo-labeled) scenes, thereby improving the semi-supervised performance of segmentation models. Experiments show that AIScene outperforms previous methods on two popular benchmarks across four settings, achieving notable improvements of 1.9% and 2.1% in the most challenging 1% labeled data.
Code (1)
Tasks
3D Semantic SegmentationData AugmentationLIDAR Semantic SegmentationScene UnderstandingSemantic SegmentationSemi-Supervised Semantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Multi-Modal Data-Efficient 3D Scene Understanding for Autonomous Driving
Efficient data utilization is crucial for advancing 3D scene understanding in autonomous driving, where reliance on heavily human-annotated LiDAR point clouds challenges fully supervised methods. Addressing this, our stu…
Autonomous DrivingLIDAR Semantic SegmentationScene UnderstandingSemantic SegmentationSSDA3D: Semi-supervised Domain Adaptation for 3D Object Detection from Point Cloud
LiDAR-based 3D object detection is an indispensable task in advanced autonomous driving systems. Though impressive detection results have been achieved by superior 3D detectors, they suffer from significant performance d…
3D Object DetectionAutonomous DrivingDomain AdaptationDomain Generalization+5Fake it, Mix it, Segment it: Bridging the Domain Gap Between Lidar Sensors
Segmentation of lidar data is a task that provides rich, point-wise information about the environment of robots or autonomous vehicles. Currently best performing neural networks for lidar segmentation are fine-tuned to s…
Autonomous VehiclesDomain AdaptationSegmentationSemantic Segmentation+2LaserMix for Semi-Supervised LiDAR Semantic Segmentation
Densely annotating LiDAR point clouds is costly, which restrains the scalability of fully-supervised learning methods. In this work, we study the underexplored semi-supervised learning (SSL) in LiDAR segmentation. Our co…
LIDAR Semantic SegmentationSegmentationSemantic SegmentationSemi-Supervised Semantic SegmentationSemi-Supervised Monocular Depth Estimation with Left-Right Consistency Using Deep Neural Network
There has been tremendous research progress in estimating the depth of a scene from a monocular camera image. Existing methods for single-image depth prediction are exclusively based on deep neural networks, and their tr…
Depth EstimationDepth PredictionMonocular Depth EstimationPrediction