paper-with-me

홈 › Papers

Pseudo Contrastive Learning for Graph-based Semi-supervised Learning

2023-02-19 · Weigang Lu, Ziyu Guan, Wei Zhao, Yaming Yang, Yuanhai Lv, Lining Xing, Baosheng Yu, DaCheng Tao

Pseudo Labeling is a technique used to improve the performance of semi-supervised Graph Neural Networks (GNNs) by generating additional pseudo-labels based on confident predictions. However, the quality of generated pseudo-labels has been a longstanding concern due to the sensitivity of the classification objective with respect to the given labels. To avoid the untrustworthy classification supervision indicating `a node belongs to a specific class,'' we favor the fault-tolerant contrasting supervision demonstrating `two nodes do not belong to the same class.'' Thus, the problem of generating high-quality pseudo-labels is then transformed into a relaxed version, i.e., identifying reliable negative pairs. To achieve this, we propose a general framework for GNNs, termed Pseudo Contrastive Learning (PCL). It separates two nodes whose positive and negative pseudo-labels target the same class. To incorporate topological knowledge into learning, we devise a topologically weighted contrastive loss that spends more effort separating negative pairs with smaller topological distances. Experimentally, we apply PCL to various GNNs, which consistently outperform their counterparts using other popular general techniques on five real-world graphs.

📄 PDF Abstract BibTeX arXiv:2302.09532

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningData Augmentation

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

RCPS: Rectified Contrastive Pseudo Supervision for Semi-Supervised Medical Image Segmentation

2023-01-13 · Xiangyu Zhao, Zengxin Qi, Sheng Wang, Qian Wang 외

Medical image segmentation methods are generally designed as fully-supervised to guarantee model performance, which require a significant amount of expert annotated samples that are high-cost and laborious. Semi-supervis…

Contrastive LearningImage SegmentationMedical Image SegmentationSegmentation+2

Semi-supervised Contrastive Outlier removal for Pseudo Expectation Maximization (SCOPE)

2022-06-28 · Sumeet Menon, David Chapman

Semi-supervised learning is the problem of training an accurate predictive model by combining a small labeled dataset with a presumably much larger unlabeled dataset. Many methods for semi-supervised deep learning have b…

Contrastive Learning

CoMatch: Semi-supervised Learning with Contrastive Graph Regularization

2020-11-23 · ICCV 2021 10 · Junnan Li, Caiming Xiong, Steven Hoi

Semi-supervised learning has been an effective paradigm for leveraging unlabeled data to reduce the reliance on labeled data. We propose CoMatch, a new semi-supervised learning method that unifies dominant approaches and…

Contrastive LearningRepresentation LearningSelf-Supervised LearningSemi-Supervised Image Classification

CLAF: Contrastive Learning with Augmented Features for Imbalanced Semi-Supervised Learning

2023-12-15 · Bowen Tao, Lan Li, Xin-Chun Li, De-Chuan Zhan

Due to the advantages of leveraging unlabeled data and learning meaningful representations, semi-supervised learning and contrastive learning have been progressively combined to achieve better performances in popular app…

Contrastive Learningimage-classificationImage Classification

Integrating Distribution Matching into Semi-Supervised Contrastive Learning for Labeled and Unlabeled Data

2026-01-08 · Shogo Nakayama, Masahiro Okuda arxiv

The advancement of deep learning has greatly improved supervised image classification. However, labeling data is costly, prompting research into unsupervised learning methods such as contrastive learning. In real-world s…

Contrastive LearningImage Classification