Improvements on Uncertainty Quantification for Node Classification via Distance-Based Regularization
Deep neural networks have achieved significant success in the last decades, but they are not well-calibrated and often produce unreliable predictions. A large number of literature relies on uncertainty quantification to evaluate the reliability of a learning model, which is particularly important for applications of out-of-distribution (OOD) detection and misclassification detection. We are interested in uncertainty quantification for interdependent node-level classification. We start our analysis based on graph posterior networks (GPNs) that optimize the uncertainty cross-entropy (UCE)-based loss function. We describe the theoretical limitations of the widely-used UCE loss. To alleviate the identified drawbacks, we propose a distance-based regularization that encourages clustered OOD nodes to remain clustered in the latent space. We conduct extensive comparison experiments on eight standard datasets and demonstrate that the proposed regularization outperforms the state-of-the-art in both OOD detection and misclassification detection.
Code (1)
Tasks
Node ClassificationOut of Distribution (OOD) DetectionUncertainty QuantificationSimilar Papers 제목 키워드 기반
Improvements on Uncertainty Quantification for Node Classification via Distance Based Regularization
Deep neural networks have achieved significant success in the last decades, but they are not well-calibrated and often produce unreliable predictions. A large number of literature relies on uncertainty quantification to …
CUQ-GNN: Committee-based Graph Uncertainty Quantification using Posterior Networks
In this work, we study the influence of domain-specific characteristics when defining a meaningful notion of predictive uncertainty on graph data. Previously, the so-called Graph Posterior Network (GPN) model has been pr…
Node ClassificationUncertainty QuantificationLinear Opinion Pooling for Uncertainty Quantification on Graphs
We address the problem of uncertainty quantification for graph-structured data, or, more specifically, the problem to quantify the predictive uncertainty in (semi-supervised) node classification. Key questions in this re…
Node ClassificationUncertainty QuantificationUNSURF: Uncertainty Quantification for Cortical Surface Reconstruction of Clinical Brain MRIs
We propose UNSURF, a novel uncertainty measure for cortical surface reconstruction of clinical brain MRI scans of any orientation, resolution, and contrast. It relies on the discrepancy between predicted voxel-wise signe…
Surface ReconstructionUncertainty QuantificationGraph Posterior Network: Bayesian Predictive Uncertainty for Node Classification
The interdependence between nodes in graphs is key to improve class predictions on nodes and utilized in approaches like Label Propagation (LP) or in Graph Neural Networks (GNN). Nonetheless, uncertainty estimation for n…
ClassificationNode ClassificationUncertainty Quantification