paper-with-me

홈 › Papers

Few-Shot Point Cloud Semantic Segmentation via Contrastive Self-Supervision and Multi-Resolution Attention

2023-02-21 · Jiahui Wang, Haiyue Zhu, Haoren Guo, Abdullah Al Mamun, Cheng Xiang, Tong Heng Lee

This paper presents an effective few-shot point cloud semantic segmentation approach for real-world applications. Existing few-shot segmentation methods on point cloud heavily rely on the fully-supervised pretrain with large annotated datasets, which causes the learned feature extraction bias to those pretrained classes. However, as the purpose of few-shot learning is to handle unknown/unseen classes, such class-specific feature extraction in pretrain is not ideal to generalize into new classes for few-shot learning. Moreover, point cloud datasets hardly have a large number of classes due to the annotation difficulty. To address these issues, we propose a contrastive self-supervision framework for few-shot learning pretrain, which aims to eliminate the feature extraction bias through class-agnostic contrastive supervision. Specifically, we implement a novel contrastive learning approach with a learnable augmentor for a 3D point cloud to achieve point-wise differentiation, so that to enhance the pretrain with managed overfitting through the self-supervision. Furthermore, we develop a multi-resolution attention module using both the nearest and farthest points to extract the local and global point information more effectively, and a center-concentrated multi-prototype is adopted to mitigate the intra-class sparsity. Comprehensive experiments are conducted to evaluate the proposed approach, which shows our approach achieves state-of-the-art performance. Moreover, a case study on practical CAM/CAD segmentation is presented to demonstrate the effectiveness of our approach for real-world applications.

📄 PDF Abstract BibTeX arXiv:2302.10501

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningFew-Shot LearningSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

SnapshotNet: Self-supervised Feature Learning for Point Cloud Data Segmentation Using Minimal Labeled Data

2022-01-13 · Xingye Li, Ling Zhang, Zhigang Zhu

Manually annotating complex scene point cloud datasets is both costly and error-prone. To reduce the reliance on labeled data, a new model called SnapshotNet is proposed as a self-supervised feature learning approach, wh…

Contrastive LearningSelf-Supervised LearningSemantic SegmentationWeakly supervised segmentation

Prototype Adaption and Projection for Few- and Zero-shot 3D Point Cloud Semantic Segmentation

2023-05-23 · Shuting He, Xudong Jiang, Wei Jiang, Henghui Ding

In this work, we address the challenging task of few-shot and zero-shot 3D point cloud semantic segmentation. The success of few-shot semantic segmentation in 2D computer vision is mainly driven by the pre-training on la…

Few-shot 3D semantic segmentationSegmentation

Few-Shot 3D Point Cloud Semantic Segmentation via Stratified Class-Specific Attention Based Transformer Network

2023-03-28 · Canyu Zhang, Zhenyao Wu, Xinyi Wu, Ziyu Zhao 외

3D point cloud semantic segmentation aims to group all points into different semantic categories, which benefits important applications such as point cloud scene reconstruction and understanding. Existing supervised poin…

Few-shot 3D Point Cloud Semantic SegmentationFew-Shot Learninggraph constructionPoint Cloud Segmentation+2

Guided Point Contrastive Learning for Semi-supervised Point Cloud Semantic Segmentation

2021-10-15 · ICCV 2021 10 · Li Jiang, Shaoshuai Shi, Zhuotao Tian, Xin Lai 외

Rapid progress in 3D semantic segmentation is inseparable from the advances of deep network models, which highly rely on large-scale annotated data for training. To address the high cost and challenges of 3D point-level …

3D Semantic SegmentationContrastive LearningPseudo LabelSemantic Segmentation

Leveraging Large-Scale Pretrained Vision Foundation Models for Label-Efficient 3D Point Cloud Segmentation

2023-11-03 · Shichao Dong, Fayao Liu, Guosheng Lin

Recently, large-scale pre-trained models such as Segment-Anything Model (SAM) and Contrastive Language-Image Pre-training (CLIP) have demonstrated remarkable success and revolutionized the field of computer vision. These…

3D Semantic SegmentationPoint Cloud SegmentationScene UnderstandingSegmentation+3