EPContrast: Effective Point-level Contrastive Learning for Large-scale Point Cloud Understanding
The acquisition of inductive bias through point-level contrastive learning holds paramount significance in point cloud pre-training. However, the square growth in computational requirements with the scale of the point cloud poses a substantial impediment to the practical deployment and execution. To address this challenge, this paper proposes an Effective Point-level Contrastive Learning method for large-scale point cloud understanding dubbed \textbf{EPContrast}, which consists of AGContrast and ChannelContrast. In practice, AGContrast constructs positive and negative pairs based on asymmetric granularity embedding, while ChannelContrast imposes contrastive supervision between channel feature maps. EPContrast offers point-level contrastive loss while concurrently mitigating the computational resource burden. The efficacy of EPContrast is substantiated through comprehensive validation on S3DIS and ScanNetV2, encompassing tasks such as semantic segmentation, instance segmentation, and object detection. In addition, rich ablation experiments demonstrate remarkable bias induction capabilities under label-efficient and one-epoch training settings.
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningInductive BiasInstance Segmentationobject-detectionObject DetectionPoint Cloud Pre-trainingSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Substituting Gadolinium in Brain MRI Using DeepContrast
Cerebral blood volume (CBV) is a hemodynamic correlate of oxygen metabolism and reflects brain activity and function. High-resolution CBV maps can be generated using the steady-state gadolinium-enhanced MRI technique. Su…
Deep LearningMasked Scene Contrast: A Scalable Framework for Unsupervised 3D Representation Learning
As a pioneering work, PointContrast conducts unsupervised 3D representation learning via leveraging contrastive learning over raw RGB-D frames and proves its effectiveness on various downstream tasks. However, the trend …
Contrastive LearningData AugmentationRepresentation LearningSemantic Segmentation+1CrossVideo: Self-supervised Cross-modal Contrastive Learning for Point Cloud Video Understanding
This paper introduces a novel approach named CrossVideo, which aims to enhance self-supervised cross-modal contrastive learning in the field of point cloud video understanding. Traditional supervised learning methods enc…
Contrastive Learningpoint cloud video understandingSelf-Supervised LearningVideo UnderstandingCAT-Det: Contrastively Augmented Transformer for Multi-modal 3D Object Detection
In autonomous driving, LiDAR point-clouds and RGB images are two major data modalities with complementary cues for 3D object detection. However, it is quite difficult to sufficiently use them, due to large inter-modal di…
3D Object DetectionAutonomous DrivingContrastive LearningData Augmentation+3Guided Point Contrastive Learning for Semi-supervised Point Cloud Semantic Segmentation
Rapid progress in 3D semantic segmentation is inseparable from the advances of deep network models, which highly rely on large-scale annotated data for training. To address the high cost and challenges of 3D point-level …
3D Semantic SegmentationContrastive LearningPseudo LabelSemantic Segmentation