Instance-aware 3D Semantic Segmentation powered by Shape Generators and Classifiers
Existing 3D semantic segmentation methods rely on point-wise or voxel-wise feature descriptors to output segmentation predictions. However, these descriptors are often supervised at point or voxel level, leading to segmentation models that can behave poorly at instance-level. In this paper, we proposed a novel instance-aware approach for 3D semantic segmentation. Our method combines several geometry processing tasks supervised at instance-level to promote the consistency of the learned feature representation. Specifically, our methods use shape generators and shape classifiers to perform shape reconstruction and classification tasks for each shape instance. This enforces the feature representation to faithfully encode both structural and local shape information, with an awareness of shape instances. In the experiments, our method significantly outperform existing approaches in 3D semantic segmentation on several public benchmarks, such as Waymo Open Dataset, SemanticKITTI and ScanNetV2.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Semantic SegmentationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Aligning Instance-Semantic Sparse Representation towards Unsupervised Object Segmentation and Shape Abstraction with Repeatable Primitives
Understanding 3D object shapes necessitates shape representation by object parts abstracted from results of instance and semantic segmentation. Promising shape representations enable computers to interpret a shape with m…
Instance SegmentationObjectSemantic SegmentationUnsupervised Object SegmentationSelf-Prediction for Joint Instance and Semantic Segmentation of Point Clouds
We develop a novel learning scheme named Self-Prediction for 3D instance and semantic segmentation of point clouds. Distinct from most existing methods that focus on designing convolutional operators, our method designs …
Instance SegmentationPredictionSegmentationSemantic SegmentationWeakly Supervised 3D Instance Segmentation without Instance-level Annotations
3D semantic scene understanding tasks have achieved great success with the emergence of deep learning, but often require a huge amount of manually annotated training data. To alleviate the annotation cost, we propose the…
3D Instance SegmentationInstance SegmentationScene UnderstandingSemantic SegmentationPoSeg: Pose-Aware Refinement Network for Human Instance Segmentation
Human instance segmentation is a core problem for human-centric scene understanding and segmenting human instances poses a unique challenge to vision systems due to large intra-class variations in both appearance and sha…
Human Instance SegmentationInstance SegmentationPose EstimationScene Understanding+2Instance segmentation with the number of clusters incorporated in embedding learning
Semantic and instance segmentation algorithms are two general yet distinct image segmentation solutions powered by Convolution Neural Network. While semantic segmentation benefits extensively from the end-to-end training…
ClusteringImage SegmentationInstance SegmentationSegmentation+1