paper-with-me

Papers

Self-Contrastive Learning with Hard Negative Sampling for Self-supervised Point Cloud Learning

2021-07-05 · Bi'an Du, Xiang Gao, Wei Hu, Xin Li

Point clouds have attracted increasing attention. Significant progress has been made in methods for point cloud analysis, which often requires costly human annotation as supervision. To address this issue, we propose a novel self-contrastive learning for self-supervised point cloud representation learning, aiming to capture both local geometric patterns and nonlocal semantic primitives based on the nonlocal self-similarity of point clouds. The contributions are two-fold: on the one hand, instead of contrasting among different point clouds as commonly employed in contrastive learning, we exploit self-similar point cloud patches within a single point cloud as positive samples and otherwise negative ones to facilitate the task of contrastive learning. On the other hand, we actively learn hard negative samples that are close to positive samples for discriminative feature learning. Experimental results show that the proposed method achieves state-of-the-art performance on widely used benchmark datasets for self-supervised point cloud segmentation and transfer learning for classification.

📄 PDF Abstract BibTeX arXiv:2107.01886

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningPoint Cloud SegmentationRepresentation LearningSelf-Supervised LearningTransfer Learning

Similar Papers 제목 키워드 기반

Bayesian Self-Supervised Contrastive Learning

2023-01-27 · Bin Liu, Bang Wang, Tianrui Li

Recent years have witnessed many successful applications of contrastive learning in diverse domains, yet its self-supervised version still remains many exciting challenges. As the negative samples are drawn from unlabele…

Contrastive Learning

BatchSampler: Sampling Mini-Batches for Contrastive Learning in Vision, Language, and Graphs

2023-06-06 · Zhen Yang, Tinglin Huang, Ming Ding, Yuxiao Dong 외

In-Batch contrastive learning is a state-of-the-art self-supervised method that brings semantically-similar instances close while pushing dissimilar instances apart within a mini-batch. Its key to success is the negative…

Contrastive LearningSTS

ConCur: Self-supervised graph representation based on contrastive learning with curriculum negative sampling

2023-09-01 · journal 2023 9 · Rong Yan, Peng Bao

Contrastive learning has made breakthrough advancements in graph representation learning, which encourages the representation of positive samples to be close and those of negative samples to be far away. However, existin…

Contrastive LearningGraph Representation LearningNode ClassificationRepresentation Learning+1

Multimodal Contrastive Learning with Hard Negative Sampling for Human Activity Recognition

2023-09-03 · Hyeongju Choi, Apoorva Beedu, Irfan Essa

Human Activity Recognition (HAR) systems have been extensively studied by the vision and ubiquitous computing communities due to their practical applications in daily life, such as smart homes, surveillance, and health m…

Activity RecognitionContrastive LearningHuman Activity Recognition

Non-Contrastive Self-Supervised Learning of Utterance-Level Speech Representations

2022-08-10 · Jaejin Cho, Raghavendra Pappagari, Piotr Żelasko, Laureano Moro-Velazquez 외

Considering the abundance of unlabeled speech data and the high labeling costs, unsupervised learning methods can be essential for better system development. One of the most successful methods is contrastive self-supervi…

Emotion RecognitionSelf-Supervised LearningSpeaker Verification