paper-with-me

홈 › Papers

Model-Free Local Recalibration of Neural Networks

2024-03-09 · R. Torres, D. J. Nott, S. A. Sisson, T. Rodrigues, J. G. Reis, G. S. Rodrigues

Artificial neural networks (ANNs) are highly flexible predictive models. However, reliably quantifying uncertainty for their predictions is a continuing challenge. There has been much recent work on "recalibration" of predictive distributions for ANNs, so that forecast probabilities for events of interest are consistent with certain frequency evaluations of them. Uncalibrated probabilistic forecasts are of limited use for many important decision-making tasks. To address this issue, we propose a localized recalibration of ANN predictive distributions using the dimension-reduced representation of the input provided by the ANN hidden layers. Our novel method draws inspiration from recalibration techniques used in the literature on approximate Bayesian computation and likelihood-free inference methods. Most existing calibration methods for ANNs can be thought of as calibrating either on the input layer, which is difficult when the input is high-dimensional, or the output layer, which may not be sufficiently flexible. Through a simulation study, we demonstrate that our method has good performance compared to alternative approaches, and explore the benefits that can be achieved by localizing the calibration based on different layers of the network. Finally, we apply our proposed method to a diamond price prediction problem, demonstrating the potential of our approach to improve prediction and uncertainty quantification in real-world applications.

📄 PDF Abstract BibTeX arXiv:2403.05756

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingmodelUncertainty Quantification

Similar Papers 제목 키워드 기반

Calibrated Multivariate Regression with Localized PIT Mappings

2024-09-17 · Lucas Kock, G. S. Rodrigues, Scott A. Sisson, Nadja Klein 외

Calibration ensures that predicted uncertainties align with observed uncertainties. While there is an extensive literature on recalibration methods for univariate probabilistic forecasts, work on calibration for multivar…

regression

Perceive, Route and Modulate: Dynamic Pattern Recalibration for Time Series Forecasting

2026-05-07 · Siru Zhong, Zhao Meng, Haohuan Fu, Haoyang Li 외 arxiv

Local temporal patterns in real-world time series continuously shift, rendering globally shared transformations suboptimal. Current deep forecasting models, despite their scale and complexity, rely on fixed weight matric…

Time Series Forecasting

Parametric and Multivariate Uncertainty Calibration for Regression and Object Detection

2022-07-04 · Fabian Küppers, Jonas Schneider, Anselm Haselhoff

Reliable spatial uncertainty evaluation of object detection models is of special interest and has been subject of recent work. In this work, we review the existing definitions for uncertainty calibration of probabilistic…

object-detectionObject DetectionObject Trackingregression+1

Training-Free Tunnel Defect Inspection and Engineering Interpretation via Visual Recalibration and Entity Reconstruction

2026-04-30 · Shipeng Liu, Liang Zhao, Dengfeng Chen, Zhanping Song arxiv

Tunnel inspection requires outputs that can support defect localization, measurement, severity grading, and engineering documentation. Existing training-free foundation-model pipelines usually stop at coarse open-vocabul…

Local Calibration: Metrics and Recalibration

2021-02-22 · Rachel Luo, Aadyot Bhatnagar, Yu Bai, Shengjia Zhao 외

Probabilistic classifiers output confidence scores along with their predictions, and these confidence scores should be calibrated, i.e., they should reflect the reliability of the prediction. Confidence scores that minim…

Decision MakingFairnessPrediction