paper-with-me

Papers

Target-Agnostic Calibration under Distribution Shift with Frequency-Aware Gradient Rectification

2025-08-27 · Yilin Zhang, Cai Xu, You Wu, Ziyu Guan, Wei Zhao arxiv

Real-world model deployments inevitably encounter distribution shifts, rendering the confidence estimates of deep neural networks highly unreliable, posing severe risks in safety-critical applications. Existing methods improve calibration via training-time regularization or post-hoc adjustment, but often rely on access to (or simulation of) target domains, limiting practicality. We propose Frequency-aware Gradient Rectification (FGR), a target-agnostic training framework for robust calibration. From a frequency perspective, FGR applies low-pass filtering to a subset of training images to diminish spurious high-frequency cues and encourage the learning of domain-invariant features. However, the associated information loss can degrade In-Distribution (ID) calibration. To resolve this trade-off, FGR treats ID calibration as a hard constraint and rectifies conflicting parameter updates via geometric projection. This ensures a first-order non-increase in the ID calibration objective without introducing an additional loss-balancing coefficient. Extensive experiments on synthetic, real-world, and semantic shift datasets demonstrate that FGR significantly improves calibration under diverse shifts while preserving ID performance, and it remains compatible with post-hoc calibration methods. Our code is available at https://github.com/YilinZhang107/FGR-Calib.

📄 PDF Abstract BibTeX arXiv:2508.19830

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Estimating calibration error under label shift without labels

2023-12-14 · Teodora Popordanoska, Gorjan Radevski, Tinne Tuytelaars, Matthew B. Blaschko

In the face of dataset shift, model calibration plays a pivotal role in ensuring the reliability of machine learning systems. Calibration error (CE) is an indicator of the alignment between the predicted probabilities an…

Bridging Multicalibration and Out-of-distribution Generalization Beyond Covariate Shift

2024-06-02 · Jiayun Wu, Jiashuo Liu, Peng Cui, Zhiwei Steven Wu

We establish a new model-agnostic optimization framework for out-of-distribution generalization via multicalibration, a criterion that ensures a predictor is calibrated across a family of overlapping groups. Multicalibra…

Out-of-Distribution Generalization

When does distribution shift break graph neural networks calibration?

2026-07-12 · Abderaouf Bahi arxiv

Graph neural networks (GNNs) are increasingly deployed in real-world applications where distribution shift is un-avoidable. However, how such shifts affect model calibration, defined as the agreement between predictive c…

Multi-class Classification

PromptShift-CRC: Drift-Aware Conformal Risk Control for Foundation Models Under Prompt and Domain Shift

2026-06-14 · Jeffery Opoku, David Banahene arxiv

Foundation models are now used in settings where the prompts they receive can change quickly. Users change, topics change, policies change, and the model may suddenly face a kind of request that was rare in the calibrati…

Question Answering

Coverage Guarantees for Pseudo-Calibrated Conformal Prediction under Distribution Shift

2026-02-16 · Farbod Siahkali, Ashwin Verma, Vijay Gupta arxiv

Conformal prediction (CP) offers distribution-free marginal coverage guarantees under an exchangeability assumption, but these guarantees can fail if the data distribution shifts. We analyze the use of pseudo-calibration…

Domain Adaptation