paper-with-me

Papers

GETS: Ensemble Temperature Scaling for Calibration in Graph Neural Networks

2024-10-12 · Dingyi Zhuang, Chonghe Jiang, Yunhan Zheng, Shenhao Wang, Jinhua Zhao

Graph Neural Networks deliver strong classification results but often suffer from poor calibration performance, leading to overconfidence or underconfidence. This is particularly problematic in high stakes applications where accurate uncertainty estimates are essential. Existing post hoc methods, such as temperature scaling, fail to effectively utilize graph structures, while current GNN calibration methods often overlook the potential of leveraging diverse input information and model ensembles jointly. In the paper, we propose Graph Ensemble Temperature Scaling, a novel calibration framework that combines input and model ensemble strategies within a Graph Mixture of Experts archi SOTA calibration techniques, reducing expected calibration error by 25 percent across 10 GNN benchmark datasets. Additionally, GETS is computationally efficient, scalable, and capable of selecting effective input combinations for improved calibration performance.

📄 PDF Abstract BibTeX arXiv:2410.09570

Code (0)

등록된 구현이 없습니다.

Tasks

Mixture-of-Experts

Methods 이 논문이 사용한 방법론

HOC 설명 없음

Similar Papers 제목 키워드 기반

Confidence Calibration under Ambiguous Ground Truth

2026-03-24 · Linwei Tao, Haoyang Luo, Minjing Dong, Chang Xu arxiv

Confidence calibration assumes a unique ground-truth label per input, yet this assumption fails wherever annotators genuinely disagree. Post-hoc calibrators fitted on majority-voted labels, the standard single-label targ…

Confidence Calibration in Large Language Model-Based Entity Matching

2025-09-23 · Iris Kamsteeg, Juan Cardenas-Cartagena, Floris van Beers, Gineke ten Holt 외 arxiv

This research aims to explore the intersection of Large Language Models and confidence calibration in Entity Matching. To this end, we perform an empirical study to compare baseline RoBERTa confidences for an Entity Matc…

Bridging the Confidence Gap: Temperature Scaling for Calibrating Test-Time Prompt Tuning

2026-09-15 · Yuwei Liang, Jian Liang, Dapeng Hu, Yinuo Xu 외 arxiv

Test-time prompt tuning (TPT) enables adaptation on a single test instance, achieving improved accuracy but often sacrificing calibration performance. Most existing calibration methods introduce additional regularization…

Improved Uncertainty Post-Calibration via Rank Preserving Transforms

2021-01-01 · Yu Bai, Tengyu Ma, Huan Wang, Caiming Xiong

Modern machine learning models with high accuracy often exhibit poor uncertainty calibration: the output probabilities of the model do not reflect its accuracy, and tend to be over-confident. Existing post-calibration me…

text-classificationText Classification

Unsupervised Temperature Scaling: Robust Post-processing Calibration for Domain Shift

2019-09-25 · Azadeh Sadat Mozafari, Hugo Siqueira Gomes, Christian Gagne

The uncertainty estimation is critical in real-world decision making applications, especially when distributional shift between the training and test data are prevalent. Many calibration methods in the literature have be…

Decision Making