PSGformer: Enhancing 3D Point Cloud Instance Segmentation via Precise Semantic Guidance
Most existing 3D instance segmentation methods are derived from 3D semantic segmentation models. However, these indirect approaches suffer from certain limitations. They fail to fully leverage global and local semantic information for accurate prediction, which hampers the overall performance of the 3D instance segmentation framework. To address these issues, this paper presents PSGformer, a novel 3D instance segmentation network. PSGformer incorporates two key advancements to enhance the performance of 3D instance segmentation. Firstly, we propose a Multi-Level Semantic Aggregation Module, which effectively captures scene features by employing foreground point filtering and multi-radius aggregation. This module enables the acquisition of more detailed semantic information from global and local perspectives. Secondly, PSGformer introduces a Parallel Feature Fusion Transformer Module that independently processes super-point features and aggregated features using transformers. The model achieves a more comprehensive feature representation by the features which connect global and local features. We conducted extensive experiments on the ScanNetv2 dataset. Notably, PSGformer exceeds compared state-of-the-art methods by 2.2% on ScanNetv2 hidden test set in terms of mAP. Our code and models will be publicly released.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Instance Segmentation3D Semantic SegmentationInstance SegmentationSegmentationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Self-Prediction for Joint Instance and Semantic Segmentation of Point Clouds
We develop a novel learning scheme named Self-Prediction for 3D instance and semantic segmentation of point clouds. Distinct from most existing methods that focus on designing convolutional operators, our method designs …
Instance SegmentationPredictionSegmentationSemantic SegmentationRelation3D : Enhancing Relation Modeling for Point Cloud Instance Segmentation
3D instance segmentation aims to predict a set of object instances in a scene, representing them as binary foreground masks with corresponding semantic labels. Currently, transformer-based methods are gaining increas…
3D Instance SegmentationContrastive LearningInstance SegmentationRelation+1Geodesic-Former: a Geodesic-Guided Few-shot 3D Point Cloud Instance Segmenter
This paper introduces a new problem in 3D point cloud: few-shot instance segmentation. Given a few annotated point clouds exemplified a target class, our goal is to segment all instances of this target class in a query p…
Few-shot Instance SegmentationInstance SegmentationSegmentationSemantic SegmentationJSNet: Joint Instance and Semantic Segmentation of 3D Point Clouds
In this paper, we propose a novel joint instance and semantic segmentation approach, which is called JSNet, in order to address the instance and semantic segmentation of 3D point clouds simultaneously. Firstly, we build …
3D Instance SegmentationClusteringInstance SegmentationSegmentation+1Pre-training with 3D Synthetic Data: Learning 3D Point Cloud Instance Segmentation from 3D Synthetic Scenes
In the recent years, the research community has witnessed growing use of 3D point cloud data for the high applicability in various real-world applications. By means of 3D point cloud, this modality enables to consider th…
3D GenerationInstance SegmentationSegmentationSemantic Segmentation