Compositional Prototype Network with Multi-view Comparision for Few-Shot Point Cloud Semantic Segmentation
Point cloud segmentation is a fundamental visual understanding task in 3D vision. A fully supervised point cloud segmentation network often requires a large amount of data with point-wise annotations, which is expensive to obtain. In this work, we present the Compositional Prototype Network that can undertake point cloud segmentation with only a few labeled training data. Inspired by the few-shot learning literature in images, our network directly transfers label information from the limited training data to unlabeled test data for prediction. The network decomposes the representations of complex point cloud data into a set of local regional representations and utilizes them to calculate the compositional prototypes of a visual concept. Our network includes a key Multi-View Comparison Component that exploits the redundant views of the support set. To evaluate the proposed method, we create a new segmentation benchmark dataset, ScanNet-$6^i$, which is built upon ScanNet dataset. Extensive experiments show that our method outperforms baselines with a significant advantage. Moreover, when we use our network to handle the long-tail problem in a fully supervised point cloud segmentation dataset, it can also effectively boost the performance of the few-shot classes.
Code (0)
등록된 구현이 없습니다.
Tasks
Few-Shot LearningPoint Cloud SegmentationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Compositional Prototypical Networks for Few-Shot Classification
It is assumed that pre-training provides the feature extractor with strong class transferability and that high novel class generalization can be achieved by simply reusing the transferable feature extractor. In this work…
AttributeClassificationIndependent Prototype Propagation for Zero-Shot Compositionality
Humans are good at compositional zero-shot reasoning; someone who has never seen a zebra before could nevertheless recognize one when we tell them it looks like a horse with black and white stripes. Machine learning syst…
AttributeCompositional Zero-Shot LearningDuplex: Dual Prototype Learning for Compositional Zero-Shot Learning
Compositional Zero-Shot Learning (CZSL) aims to enable models to recognize novel compositions of visual states and objects that were absent during training. Existing methods predominantly focus on learning semantic repre…
Compositional Zero-Shot LearningGraph Neural NetworkLearning Semantic RepresentationsPrompt Engineering+2Dual-Modal Prototype Joint Learning for Compositional Zero-Shot Learning
Compositional Zero-Shot Learning (CZSL) aims to recognize novel compositions of attributes and objects by leveraging knowledge learned from seen compositions. Recent approaches have explored the use of Vision-Language Mo…
Compositional Zero-Shot LearningPrompt EngineeringZero-Shot LearningLearning Clustering-based Prototypes for Compositional Zero-shot Learning
Learning primitive (i.e., attribute and object) concepts from seen compositions is the primary challenge of Compositional Zero-Shot Learning (CZSL). Existing CZSL solutions typically rely on oversimplified data assumptio…
AttributeClusteringCompositional Zero-Shot LearningContrastive Learning+1