paper-with-me

홈 › Papers

Deep Insights into Noisy Pseudo Labeling on Graph Data

2023-10-02 · NeurIPS 2023 11 · Botao Wang, Jia Li, Yang Liu, Jiashun Cheng, Yu Rong, Wenjia Wang, Fugee Tsung

Pseudo labeling (PL) is a wide-applied strategy to enlarge the labeled dataset by self-annotating the potential samples during the training process. Several works have shown that it can improve the graph learning model performance in general. However, we notice that the incorrect labels can be fatal to the graph training process. Inappropriate PL may result in the performance degrading, especially on graph data where the noise can propagate. Surprisingly, the corresponding error is seldom theoretically analyzed in the literature. In this paper, we aim to give deep insights of PL on graph learning models. We first present the error analysis of PL strategy by showing that the error is bounded by the confidence of PL threshold and consistency of multi-view prediction. Then, we theoretically illustrate the effect of PL on convergence property. Based on the analysis, we propose a cautious pseudo labeling methodology in which we pseudo label the samples with highest confidence and multi-view consistency. Finally, extensive experiments demonstrate that the proposed strategy improves graph learning process and outperforms other PL strategies on link prediction and node classification tasks.

📄 PDF Abstract BibTeX arXiv:2310.01634

Code (1)

AcEbt/CPL 공식 구현 pytorch

Tasks

Graph LearningLink PredictionNode ClassificationPseudo Label

Similar Papers 제목 키워드 기반

Decoupled Pseudo-labeling for Semi-Supervised Monocular 3D Object Detection

2024-03-26 · CVPR 2024 1 · Jiacheng Zhang, Jiaming Li, Xiangru Lin, Wei zhang 외

We delve into pseudo-labeling for semi-supervised monocular 3D object detection (SSM3OD) and discover two primary issues: a misalignment between the prediction quality of 3D and 2D attributes and the tendency of depth su…

3D Object DetectionMonocular 3D Object Detectionobject-detectionObject Detection+1

When Noisy Labels Meet Class Imbalance on Graphs: A Graph Augmentation Method with LLM and Pseudo Label

2025-07-24 · Riting Xia, Rucong Wang, Yulin Liu, Anchen Li 외 arxiv

Class-imbalanced graph node classification is a practical yet underexplored research problem. Although recent studies have attempted to address this issue, they typically assume clean and reliable labels when processing …

Node Classification

HPL-ESS: Hybrid Pseudo-Labeling for Unsupervised Event-based Semantic Segmentation

2024-03-25 · CVPR 2024 1 · Linglin Jing, Yiming Ding, Yunpeng Gao, Zhigang Wang 외

Event-based semantic segmentation has gained popularity due to its capability to deal with scenarios under high-speed motion and extreme lighting conditions, which cannot be addressed by conventional RGB cameras. Since i…

Domain AdaptationImage ReconstructionSegmentationSemantic Segmentation+1

Analysis of Pseudo-Labeling for Online Source-Free Universal Domain Adaptation

2025-04-16 · Pascal Schlachter, Jonathan Fuss, Bin Yang

A domain (distribution) shift between training and test data often hinders the real-world performance of deep neural networks, necessitating unsupervised domain adaptation (UDA) to bridge this gap. Online source-free UDA…

Domain AdaptationPseudo LabelUniversal Domain AdaptationUnsupervised Domain Adaptation

LayerMatch: Do Pseudo-labels Benefit All Layers?

2024-06-20 · Chaoqi Liang, Guanglei Yang, Lifeng Qiao, Zitong Huang 외

Deep neural networks have achieved remarkable performance across various tasks when supplied with large-scale labeled data. However, the collection of labeled data can be time-consuming and labor-intensive. Semi-supervis…

AllAvgClusteringPseudo Label