Graph-Based Uncertainty-Aware Self-Training with Stochastic Node Labeling
Self-training has become a popular semi-supervised learning technique for leveraging unlabeled data. However, the over-confidence of pseudo-labels remains a key challenge. In this paper, we propose a novel \emph{graph-based uncertainty-aware self-training} (GUST) framework to combat over-confidence in node classification. Drawing inspiration from the uncertainty integration idea introduced by Wang \emph{et al.}~\cite{wang2024uncertainty}, our method largely diverges from previous self-training approaches by focusing on \emph{stochastic node labeling} grounded in the graph topology. Specifically, we deploy a Bayesian-inspired module to estimate node-level uncertainty, incorporate these estimates into the pseudo-label generation process via an expectation-maximization (EM)-like step, and iteratively update both node embeddings and adjacency-based transformations. Experimental results on several benchmark graph datasets demonstrate that our GUST framework achieves state-of-the-art performance, especially in settings where labeled data is extremely sparse.
Code (0)
등록된 구현이 없습니다.
Tasks
Node ClassificationPseudo LabelSimilar Papers 제목 키워드 기반
Uncertainty-Aware Graph Self-Training with Expectation-Maximization Regularization
In this paper, we propose a novel \emph{uncertainty-aware graph self-training} approach for semi-supervised node classification. Our method introduces an Expectation-Maximization (EM) regularization scheme to incorporate…
Node ClassificationPseudo LabelAnswering from Sure to Uncertain: Uncertainty-Aware Curriculum Learning for Video Question Answering
While significant advancements have been made in video question answering (VideoQA), the potential benefits of enhancing model generalization through tailored difficulty scheduling have been largely overlooked in existin…
Question AnsweringSchedulingVideo Question AnsweringUncertainty Modeling in Graph Neural Networks via Stochastic Differential Equations
We address the problem of learning uncertainty-aware representations for graph-structured data. While Graph Neural Ordinary Differential Equations (GNODE) are effective in learning node representations, they fail to quan…
Uncertainty QuantificationStochastic Vision Transformers with Wasserstein Distance-Aware Attention
Self-supervised learning is one of the most promising approaches to acquiring knowledge from limited labeled data. Despite the substantial advancements made in recent years, self-supervised models have posed a challenge …
Out-of-Distribution DetectionSelf-Supervised LearningTransfer LearningUAT-LITE: Inference-Time Uncertainty-Aware Attention for Pretrained Transformers
Neural NLP models are often miscalibrated and overconfident, assigning high confidence to incorrect predictions and failing to express uncertainty during internal evidence aggregation. This undermines selective predictio…