Density-Guided Semi-Supervised 3D Semantic Segmentation with Dual-Space Hardness Sampling
Densely annotating the large-scale point clouds is laborious. To alleviate the annotation burden contrastive learning has attracted increasing attention for tackling semi-supervised 3D semantic segmentation. However existing point-to-point contrastive learning techniques in literature are generally sensitive to outliers resulting in insufficient modeling of the point-wise representations. To address this problem we propose a method named DDSemi for semi-supervised 3D semantic segmentation where a density-guided contrastive learning technique is explored. This technique calculates the contrastive loss in a point-to-anchor manner by estimating an anchor for each class from the memory bank based on the finding that the cluster centers tend to be located in dense regions. In this technique an inter-contrast loss is derived from the perturbed unlabeled point cloud pairs while an intra-contrast loss is derived from a single unlabeled point cloud. The derived losses could enhance the discriminability of the features and implicitly constrain the semantic consistency between the perturbed unlabeled point cloud pairs. In addition we propose a dual-space hardness sampling strategy to pay more attention to the hard samples located in sparse regions of both the geometric space and feature space by reweighting the point-wise intra-contrast loss. Experimental results on both indoor-scene and outdoor-scene datasets demonstrate that the proposed method outperforms the comparative state-of-the-art semi-supervised methods.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Semantic SegmentationContrastive LearningSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Hunting Sparsity: Density-Guided Contrastive Learning for Semi-Supervised Semantic Segmentation
Recent semi-supervised semantic segmentation methods combine pseudo labeling and consistency regularization to enhance model generalization from perturbation-invariant training. In this work, we argue that adequate s…
Contrastive LearningDensity EstimationSemantic SegmentationSemi-Supervised Semantic SegmentationTowards the Uncharted: Density-Descending Feature Perturbation for Semi-supervised Semantic Segmentation
Semi-supervised semantic segmentation allows model to mine effective supervision from unlabeled data to complement label-guided training. Recent research has primarily focused on consistency regularization techniques, ex…
Semantic SegmentationSemi-Supervised Semantic SegmentationSemi-supervised semantic segmentation needs strong, varied perturbations
Consistency regularization describes a class of approaches that have yielded ground breaking results in semi-supervised classification problems. Prior work has established the cluster assumption - under which the data di…
General ClassificationSegmentationSemantic SegmentationSemi-Supervised Semantic SegmentationSemi-supervised semantic segmentation needs strong, high-dimensional perturbations
Consistency regularization describes a class of approaches that have yielded ground breaking results in semi-supervised classification problems. Prior work has established the cluster assumption\,---\,under which the dat…
SegmentationSemantic SegmentationSemi-Supervised Semantic SegmentationVocal Bursts Intensity PredictionNeighbor Does Matter: Density-Aware Contrastive Learning for Medical Semi-supervised Segmentation
In medical image analysis, multi-organ semi-supervised segmentation faces challenges such as insufficient labels and low contrast in soft tissues. To address these issues, existing studies typically employ semi-supervise…
Contrastive LearningImage SegmentationMedical Image AnalysisMedical Image Segmentation+3