COARSE3D: Class-Prototypes for Contrastive Learning in Weakly-Supervised 3D Point Cloud Segmentation
Annotation of large-scale 3D data is notoriously cumbersome and costly. As an alternative, weakly-supervised learning alleviates such a need by reducing the annotation by several order of magnitudes. We propose COARSE3D, a novel architecture-agnostic contrastive learning strategy for 3D segmentation. Since contrastive learning requires rich and diverse examples as keys and anchors, we leverage a prototype memory bank capturing class-wise global dataset information efficiently into a small number of prototypes acting as keys. An entropy-driven sampling technique then allows us to select good pixels from predictions as anchors. Experiments on three projection-based backbones show we outperform baselines on three challenging real-world outdoor datasets, working with as low as 0.001% annotations.
Code (1)
Tasks
3D Semantic SegmentationContrastive LearningLIDAR Semantic SegmentationPoint Cloud SegmentationSemi-Supervised Semantic SegmentationWeakly Supervised 3D Point Cloud SegmentationWeakly-supervised LearningWeakly supervised Semantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Weakly-Supervised Domain Adaptive Semantic Segmentation With Prototypical Contrastive Learning
There has been a lot of effort in improving the performance of unsupervised domain adaptation for semantic segmentation task, however there is still a huge gap in performance when compared with supervised learning. I…
Contrastive LearningDomain AdaptationSemantic SegmentationUnsupervised Domain AdaptationPrototype Propagation Networks (PPN) for Weakly-supervised Few-shot Learning on Category Graph
A variety of machine learning applications expect to achieve rapid learning from a limited number of labeled data. However, the success of most current models is the result of heavy training on big data. Meta-learning ad…
Few-Shot LearningGeneral ClassificationMeta-LearningLearning to Tell Apart: Weakly Supervised Video Anomaly Detection via Disentangled Semantic Alignment
Recent advancements in weakly-supervised video anomaly detection have achieved remarkable performance by applying the multiple instance learning paradigm based on multimodal foundation models such as CLIP to highlight an…
Weakly-supervised Video Anomaly DetectionMultiple Instance LearningContrastive LearningNegative Prototypes Guided Contrastive Learning for WSOD
Weakly Supervised Object Detection (WSOD) with only image-level annotation has recently attracted wide attention. Many existing methods ignore the inter-image relationship of instances which share similar characteristics…
Contrastive Learningobject-detectionObject DetectionPseudo Label+1Toward Modality Gap: Vision Prototype Learning for Weakly-supervised Semantic Segmentation with CLIP
The application of Contrastive Language-Image Pre-training (CLIP) in Weakly Supervised Semantic Segmentation (WSSS) research powerful cross-modal semantic understanding capabilities. Existing methods attempt to optimize …
Semantic SegmentationWeakly supervised Semantic SegmentationWeakly-Supervised Semantic Segmentation