paper-with-me

Papers

Valid Conformal Prediction for Dynamic GNNs

2024-05-29 · Ed Davis, Ian Gallagher, Daniel John Lawson, Patrick Rubin-Delanchy

Dynamic graphs provide a flexible data abstraction for modelling many sorts of real-world systems, such as transport, trade, and social networks. Graph neural networks (GNNs) are powerful tools allowing for different kinds of prediction and inference on these systems, but getting a handle on uncertainty, especially in dynamic settings, is a challenging problem. In this work we propose to use a dynamic graph representation known in the tensor literature as the unfolding, to achieve valid prediction sets via conformal prediction. This representation, a simple graph, can be input to any standard GNN and does not require any modification to existing GNN architectures or conformal prediction routines. One of our key contributions is a careful mathematical consideration of the different inference scenarios which can arise in a dynamic graph modelling context. For a range of practically relevant cases, we obtain valid prediction sets with almost no assumptions, even dispensing with exchangeability. In a more challenging scenario, which we call the semi-inductive regime, we achieve valid prediction under stronger assumptions, akin to stationarity. We provide real data examples demonstrating validity, showing improved accuracy over baselines, and sign-posting different failure modes which can occur when those assumptions are violated.

📄 PDF Abstract BibTeX arXiv:2405.19230

Code (1)

edwarddavis1/valid_conformal_for_dynamic_gnn 공식 구현 pytorch

Tasks

Conformal PredictionDynamic graph embeddingGraph EmbeddingPredictionUncertainty Quantificationvalid

Similar Papers 제목 키워드 기반

RoCP-GNN: Robust Conformal Prediction for Graph Neural Networks in Node-Classification

2024-08-25 · S. Akansha

Graph Neural Networks (GNNs) have emerged as powerful tools for predicting outcomes in graph-structured data. However, a notable limitation of GNNs is their inability to provide robust uncertainty estimates, which underm…

Conformal PredictionLink PredictionNode ClassificationPrediction+1

Uncertainty Quantification over Graph with Conformalized Graph Neural Networks

2023-05-23 · NeurIPS 2023 11 · Kexin Huang, Ying Jin, Emmanuel Candès, Jure Leskovec

Graph Neural Networks (GNNs) are powerful machine learning prediction models on graph-structured data. However, GNNs lack rigorous uncertainty estimates, limiting their reliable deployment in settings where the cost of e…

Conformal PredictionPredictionUncertainty Quantificationvalid

Conditional Shift-Robust Conformal Prediction for Graph Neural Network

2024-05-20 · S. Akansha

Graph Neural Networks (GNNs) have emerged as potent tools for predicting outcomes in graph-structured data. Despite their efficacy, a significant drawback of GNNs lies in their limited ability to provide robust uncertain…

Conformal PredictionGraph Neural NetworkNode ClassificationPrediction+1

On the Temperature of Bayesian Graph Neural Networks for Conformal Prediction

2023-10-17 · Seohyeon Cha, Honggu Kang, Joonhyuk Kang

Accurate uncertainty quantification in graph neural networks (GNNs) is essential, especially in high-stakes domains where GNNs are frequently employed. Conformal prediction (CP) offers a promising framework for quantifyi…

Conformal PredictionPredictionUncertainty Quantificationvalid

Multi-model Ensemble Conformal Prediction in Dynamic Environments

2024-11-06 · Erfan Hajihashemi, Yanning Shen

Conformal prediction is an uncertainty quantification method that constructs a prediction set for a previously unseen datum, ensuring the true label is included with a predetermined coverage probability. Adaptive conform…

Conformal PredictionmodelPredictionUncertainty Quantification+1