Bidirectional Feature Globalization for Few-shot Semantic Segmentation of 3D Point Cloud Scenes
Few-shot segmentation of point cloud remains a challenging task, as there is no effective way to convert local point cloud information to global representation, which hinders the generalization ability of point features. In this study, we propose a bidirectional feature globalization (BFG) approach, which leverages the similarity measurement between point features and prototype vectors to embed global perception to local point features in a bidirectional fashion. With point-to-prototype globalization (Po2PrG), BFG aggregates local point features to prototypes according to similarity weights from dense point features to sparse prototypes. With prototype-to-point globalization (Pr2PoG), the global perception is embedded to local point features based on similarity weights from sparse prototypes to dense point features. The sparse prototypes of each class embedded with global perception are summarized to a single prototype for few-shot 3D segmentation based on the metric learning framework. Extensive experiments on S3DIS and ScanNet demonstrate that BFG significantly outperforms the state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Few-Shot Semantic SegmentationMetric LearningSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Stacked U-Nets: A No-Frills Approach to Natural Image Segmentation
Many imaging tasks require global information about all pixels in an image. Conventional bottom-up classification networks globalize information by decreasing resolution; features are pooled and downsampled into a single…
General ClassificationImage Segmentationobject-detectionObject Detection+2Towards Deeper and Better Multi-view Feature Fusion for 3D Semantic Segmentation
3D point clouds are rich in geometric structure information, while 2D images contain important and continuous texture information. Combining 2D information to achieve better 3D semantic segmentation has become mainstream…
3D Semantic SegmentationScene UnderstandingSegmentationSemantic SegmentationSemantic Segmentation with Boundary Neural Fields
The state-of-the-art in semantic segmentation is currently represented by fully convolutional networks (FCNs). However, FCNs use large receptive fields and many pooling layers, both of which cause blurring and low spatia…
Boundary Detectionglobal-optimizationObject LocalizationSegmentation+1Bidirectional Multi-scale Attention Networks for Semantic Segmentation of Oblique UAV Imagery
Semantic segmentation for aerial platforms has been one of the fundamental scene understanding task for the earth observation. Most of the semantic segmentation research focused on scenes captured in nadir view, in which…
Earth ObservationScene UnderstandingSegmentationSemantic SegmentationBidirectional RNN-based Few Shot Learning for 3D Medical Image Segmentation
Segmentation of organs of interest in 3D medical images is necessary for accurate diagnosis and longitudinal studies. Though recent advances using deep learning have shown success for many segmentation tasks, large datas…
Few-Shot LearningImage SegmentationMedical Image SegmentationOrgan Segmentation+3