Valid Conformal Prediction for Dynamic GNNs
Dynamic graphs provide a flexible data abstraction for modelling many sorts of real-world systems, such as transport, trade, and social networks. Graph neural networks (GNNs) are powerful tools allowing for different kinds of prediction and inference on these systems, but getting a handle on uncertainty, especially in dynamic settings, is a challenging problem. In this work we propose to use a dynamic graph representation known in the tensor literature as the unfolding, to achieve valid prediction sets via conformal prediction. This representation, a simple graph, can be input to any standard GNN and does not require any modification to existing GNN architectures or conformal prediction routines. One of our key contributions is a careful mathematical consideration of the different inference scenarios which can arise in a dynamic graph modelling context. For a range of practically relevant cases, we obtain valid prediction sets with almost no assumptions, even dispensing with exchangeability. In a more challenging scenario, which we call the semi-inductive regime, we achieve valid prediction under stronger assumptions, akin to stationarity. We provide real data examples demonstrating validity, showing improved accuracy over baselines, and sign-posting different failure modes which can occur when those assumptions are violated.
Code (1)
Tasks
Conformal PredictionDynamic graph embeddingGraph EmbeddingPredictionUncertainty QuantificationvalidSimilar Papers 제목 키워드 기반
RoCP-GNN: Robust Conformal Prediction for Graph Neural Networks in Node-Classification
Graph Neural Networks (GNNs) have emerged as powerful tools for predicting outcomes in graph-structured data. However, a notable limitation of GNNs is their inability to provide robust uncertainty estimates, which underm…
Conformal PredictionLink PredictionNode ClassificationPrediction+1Uncertainty Quantification over Graph with Conformalized Graph Neural Networks
Graph Neural Networks (GNNs) are powerful machine learning prediction models on graph-structured data. However, GNNs lack rigorous uncertainty estimates, limiting their reliable deployment in settings where the cost of e…
Conformal PredictionPredictionUncertainty QuantificationvalidConditional Shift-Robust Conformal Prediction for Graph Neural Network
Graph Neural Networks (GNNs) have emerged as potent tools for predicting outcomes in graph-structured data. Despite their efficacy, a significant drawback of GNNs lies in their limited ability to provide robust uncertain…
Conformal PredictionGraph Neural NetworkNode ClassificationPrediction+1On the Temperature of Bayesian Graph Neural Networks for Conformal Prediction
Accurate uncertainty quantification in graph neural networks (GNNs) is essential, especially in high-stakes domains where GNNs are frequently employed. Conformal prediction (CP) offers a promising framework for quantifyi…
Conformal PredictionPredictionUncertainty QuantificationvalidMulti-model Ensemble Conformal Prediction in Dynamic Environments
Conformal prediction is an uncertainty quantification method that constructs a prediction set for a previously unseen datum, ensuring the true label is included with a predetermined coverage probability. Adaptive conform…
Conformal PredictionmodelPredictionUncertainty Quantification+1