paper-with-me

Papers

Conditional Shift-Robust Conformal Prediction for Graph Neural Network

2024-05-20 · S. Akansha

Graph Neural Networks (GNNs) have emerged as potent tools for predicting outcomes in graph-structured data. Despite their efficacy, a significant drawback of GNNs lies in their limited ability to provide robust uncertainty estimates, posing challenges to their reliability in contexts where errors carry significant consequences. Moreover, GNNs typically excel in in-distribution settings, assuming that training and test data follow identical distributions a condition often unmet in real world graph data scenarios. In this article, we leverage conformal prediction, a widely recognized statistical technique for quantifying uncertainty by transforming predictive model outputs into prediction sets, to address uncertainty quantification in GNN predictions amidst conditional shift\footnote{Representing the change in conditional probability distribution \(P(label|input)\) from source domain to target domain.} in graph-based semi-supervised learning (SSL). Additionally, we propose a novel loss function aimed at refining model predictions by minimizing conditional shift in latent stages. Termed Conditional Shift Robust (CondSR) conformal prediction for GNNs, our approach CondSR is model-agnostic and adaptable to various classification models. We validate the effectiveness of our method on standard graph benchmark datasets, integrating it with state-of-the-art GNNs in node classification tasks. Comprehensive evaluations demonstrate that our approach consistently achieves any predefined target marginal coverage, enhances the accuracy of state of the art GNN models by up to 12\% under conditional shift, and reduces the prediction set size by up to 48\%. The code implementation is publicly available for further exploration and experimentation.

📄 PDF Abstract BibTeX arXiv:2405.11968

Code (0)

등록된 구현이 없습니다.

Tasks

Conformal PredictionGraph Neural NetworkNode ClassificationPredictionUncertainty Quantification

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Training-Conditional Coverage Bounds under Covariate Shift

2024-05-26 · Mehrdad Pournaderi, Yu Xiang

Training-conditional coverage guarantees in conformal prediction concern the concentration of the error distribution, conditional on the training data, below some nominal level. The conformal prediction methodology has r…

Conformal PredictionPrediction

Audited Conformal Prediction for Classification under Unknown Distribution Shift

2026-06-12 · Yanfei Zhou, Rizal Fathony, Nam H. Nguyen, Matteo Sesia arxiv

We consider the problem of uncertainty quantification for a pretrained classification model deployed under unknown distribution shift. We propose Audited Conformal Prediction (ACP), a method that leverages a small labele…

Robust Conditional Conformal Prediction via Branched Normalizing Flow

2026-05-03 · Rui Xu, Xingyuan Chen, Wenxing Huang, Minxuan Huang 외 arxiv

Conformal prediction (CP) constructs prediction sets with marginal coverage guarantees under the assumption that the calibration and test distributions are identical. However, under distribution shift, existing approache…

SpeedCP: Fast Kernel-based Conditional Conformal Prediction

2025-09-28 · Yating Liu, Yeo Jin Jung, Zixuan Wu, So Won Jeong 외 arxiv

Conformal prediction provides distribution-free prediction sets with finite-sample conditional guarantees. We build upon the RKHS-based framework of Gibbs et al. (2023), which leverages families of covariate shifts to pr…

Weighted Bayesian Conformal Prediction

2026-04-07 · Xiayin Lou, Peng Luo arxiv

Conformal prediction provides distribution-free prediction intervals with finite-sample coverage guarantees, and recent work by Snell \& Griffiths reframes it as Bayesian Quadrature (BQ-CP), yielding powerful data-condit…