Adaptive Margin Contrastive Learning for Ambiguity-aware 3D Semantic Segmentation
In this paper, we propose an adaptive margin contrastive learning method for 3D point cloud semantic segmentation, namely AMContrast3D. Most existing methods use equally penalized objectives, which ignore per-point ambiguities and less discriminated features stemming from transition regions. However, as highly ambiguous points may be indistinguishable even for humans, their manually annotated labels are less reliable, and hard constraints over these points would lead to sub-optimal models. To address this, we design adaptive objectives for individual points based on their ambiguity levels, aiming to ensure the correctness of low-ambiguity points while allowing mistakes for high-ambiguity points. Specifically, we first estimate ambiguities based on position embeddings. Then, we develop a margin generator to shift decision boundaries for contrastive feature embeddings, so margins are narrowed due to increasing ambiguities with even negative margins for extremely high-ambiguity points. Experimental results on large-scale datasets, S3DIS and ScanNet, demonstrate that our method outperforms state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Semantic SegmentationContrastive LearningSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Ambiguity-aware Point Cloud Segmentation by Adaptive Margin Contrastive Learning
This paper proposes an adaptive margin contrastive learning method for 3D semantic segmentation on point clouds. Most existing methods use equally penalized objectives, which ignore the per-point ambiguities and less dis…
Point Cloud Segmentation3D Semantic SegmentationContrastive LearningPoint CloudsMargin Preserving Self-paced Contrastive Learning Towards Domain Adaptation for Medical Image Segmentation
To bridge the gap between the source and target domains in unsupervised domain adaptation (UDA), the most common strategy puts focus on matching the marginal distributions in the feature space through adversarial learnin…
Cardiac SegmentationContrastive LearningDomain AdaptationImage Segmentation+4Ambiguity-Aware and High-Order Relation Learning for Multi-Grained Image-Text Matching
Image-text matching is crucial for bridging the semantic gap between computer vision and natural language processing. However, existing methods still face challenges in handling high-order associations and semantic ambig…
Contrastive LearningImage-text matchingSLiNT: Structure-aware Language Model with Injection and Contrastive Training for Knowledge Graph Completion
Link prediction in knowledge graphs requires integrating structural information and semantic context to infer missing entities. While large language models offer strong generative reasoning capabilities, their limited ex…
Knowledge Graph CompletionRepresentation LearningContrastive LearningKnowledge GraphsKDMCSE: Knowledge Distillation Multimodal Sentence Embeddings with Adaptive Angular margin Contrastive Learning
Previous work on multimodal sentence embedding has proposed multimodal contrastive learning and achieved promising results. However, by taking the rest of the batch as negative samples without reviewing when forming cont…
Contrastive LearningKnowledge DistillationSemantic Textual SimilaritySentence+4