Semi-supervised 3D shape segmentation with multilevel consistency and part substitution
The lack of fine-grained 3D shape segmentation data is the main obstacle to developing learning-based 3D segmentation techniques. We propose an effective semi-supervised method for learning 3D segmentations from a few labeled 3D shapes and a large amount of unlabeled 3D data. For the unlabeled data, we present a novel multilevel consistency loss to enforce consistency of network predictions between perturbed copies of a 3D shape at multiple levels: point-level, part-level, and hierarchical level. For the labeled data, we develop a simple yet effective part substitution scheme to augment the labeled 3D shapes with more structural variations to enhance training. Our method has been extensively validated on the task of 3D object semantic segmentation on PartNet and ShapeNetPart, and indoor scene semantic segmentation on ScanNet. It exhibits superior performance to existing semi-supervised and unsupervised pre-training 3D approaches. Our code and trained models are publicly available at https://github.com/isunchy/semi_supervised_3d_segmentation.
Code (1)
Tasks
SegmentationSemantic SegmentationSemantic Segmentation on ScanNetUnsupervised Pre-trainingSimilar Papers 제목 키워드 기반
Striving for Simplicity: Simple Yet Effective Prior-Aware Pseudo-Labeling for Semi-Supervised Ultrasound Image Segmentation
Medical ultrasound imaging is ubiquitous, but manual analysis struggles to keep pace. Automated segmentation can help but requires large labeled datasets, which are scarce. Semi-supervised learning leveraging both unlabe…
DecoderImage SegmentationMedical Image SegmentationSemantic Segmentation+1Uncertainty-Guided Mutual Consistency Learning for Semi-Supervised Medical Image Segmentation
Medical image segmentation is a fundamental and critical step in many clinical approaches. Semi-supervised learning has been widely applied to medical image segmentation tasks since it alleviates the heavy burden of acqu…
Brain Tumor SegmentationImage SegmentationLeft Atrium SegmentationMedical Image Segmentation+43D Shape Reconstruction from a Single 2D Image via 2D-3D Self-Consistency
Aiming at inferring 3D shapes from 2D images, 3D shape reconstruction has drawn huge attention from researchers in computer vision and deep learning communities. However, it is not practical to assume that 2D input image…
3D Reconstruction3D Shape Reconstruction3D Shape Reconstruction From A Single 2D ImageForeground SegmentationDual-scale Enhanced and Cross-generative Consistency Learning for Semi-supervised Medical Image Segmentation
Medical image segmentation plays a crucial role in computer-aided diagnosis. However, existing methods heavily rely on fully supervised training, which requires a large amount of labeled data with time-consuming pixel-wi…
Image SegmentationMedical Image SegmentationSegmentationSemantic Segmentation+1Shape-aware Semi-supervised 3D Semantic Segmentation for Medical Images
Semi-supervised learning has attracted much attention in medical image segmentation due to challenges in acquiring pixel-wise image annotations, which is a crucial step for building high-performance deep learning methods…
3D Semantic SegmentationImage SegmentationMedical Image SegmentationObject+2