paper-with-me

홈 › Papers

SleepPriorCL: Contrastive Representation Learning with Prior Knowledge-based Positive Mining and Adaptive Temperature for Sleep Staging

2021-10-15 · Hongjun Zhang, Jing Wang, Qinfeng Xiao, Jiaoxue Deng, Youfang Lin

The objective of this paper is to learn semantic representations for sleep stage classification from raw physiological time series. Although supervised methods have gained remarkable performance, they are limited in clinical situations due to the requirement of fully labeled data. Self-supervised learning (SSL) based on contrasting semantically similar (positive) and dissimilar (negative) pairs of samples have achieved promising success. However, existing SSL methods suffer the problem that many semantically similar positives are still uncovered and even treated as negatives. In this paper, we propose a novel SSL approach named SleepPriorCL to alleviate the above problem. Advances of our approach over existing SSL methods are two-fold: 1) by incorporating prior domain knowledge into the training regime of SSL, more semantically similar positives are discovered without accessing ground-truth labels; 2) via investigating the influence of the temperature in contrastive loss, an adaptive temperature mechanism for each sample according to prior domain knowledge is further proposed, leading to better performance. Extensive experiments demonstrate that our method achieves state-of-the-art performance and consistently outperforms baselines.

📄 PDF Abstract BibTeX arXiv:2110.09966

Code (0)

등록된 구현이 없습니다.

Tasks

Representation LearningSelf-Supervised LearningSleep StagingTime SeriesTime Series Analysis

Similar Papers 제목 키워드 기반

Integrating Prior Knowledge in Contrastive Learning with Kernel

2022-06-03 · Benoit Dufumier, Carlo Alberto Barbano, Robin Louiset, Edouard Duchesnay 외

Data augmentation is a crucial component in unsupervised contrastive learning (CL). It determines how positive samples are defined and, ultimately, the quality of the learned representation. In this work, we open the doo…

Contrastive LearningData Augmentation

Positive Unlabeled Contrastive Learning

2022-06-01 · Anish Acharya, Sujay Sanghavi, Li Jing, Bhargav Bhushanam 외

Self-supervised pretraining on unlabeled data followed by supervised fine-tuning on labeled data is a popular paradigm for learning from limited labeled examples. We extend this paradigm to the classical positive unlabel…

Contrastive LearningPseudo Label

Contrastive Approach to Prior Free Positive Unlabeled Learning

2024-02-08 · Anish Acharya, Sujay Sanghavi

Positive Unlabeled (PU) learning refers to the task of learning a binary classifier given a few labeled positive samples, and a set of unlabeled samples (which could be positive or negative). In this paper, we propose a …

Representation Learning

Harmony in Diversity: Multi-domain Contrastive Policy Optimization for Large Reasoning Models

2026-05-25 · Zongji Yu, Wenshui Luo, Yiliu Sun, Hao Fang 외 arxiv

Post-training has significantly enhanced the reasoning capability of Large Reasoning Models (LRMs), especially with Reinforcement Learning (RL) like Group Relative Policy Optimization (GRPO). However, GRPO-style RL metho…

Reinforcement Learning

Contrastive Positive Mining for Unsupervised 3D Action Representation Learning

2022-08-06 · Haoyuan Zhang, Yonghong Hou, Wenjing Zhang, Wanqing Li

Recent contrastive based 3D action representation learning has made great progress. However, the strict positive/negative constraint is yet to be relaxed and the use of non-self positive is yet to be explored. In this pa…

DiversityRepresentation LearningSelf-supervised Skeleton-based Action Recognition