On the validity of using the delta method for calculating the uncertainty of the predictions from an overparameterized model
The uncertainty in the prediction calculated using the delta method for an overparameterized (parametric) black-box model is shown to be larger or equal to the uncertainty in the prediction of a canonical (minimal) model. Equality holds if the additional parameters of the overparameterized model do not add flexibility to the model. As a conclusion, for an overparameterized black-box model, the calculated uncertainty in the prediction by the delta method is not underestimated. The results are shown analytically and are validated in a simulation experiment where the relationship between the normalized traction force and the wheel slip of a car is modelled using e.g., a neural network
Code (0)
등록된 구현이 없습니다.
Tasks
PredictionSimilar Papers 제목 키워드 기반
Bayesian Inference for Consistent Predictions in Overparameterized Nonlinear Regression
The remarkable generalization performance of large-scale models has been challenging the conventional wisdom of the statistical learning theory. Although recent theoretical studies have shed light on this behavior in lin…
Bayesian InferenceLearning Theoryregressionδ-CLUE: Diverse Sets of Explanations for Uncertainty Estimates
To interpret uncertainty estimates from differentiable probabilistic models, recent work has proposed generating Counterfactual Latent Uncertainty Explanations (CLUEs). However, for a single input, such approaches could …
counterfactualSingle Model Uncertainty Estimation via Stochastic Data Centering
We are interested in estimating the uncertainties of deep neural networks, which play an important role in many scientific and engineering problems. In this paper, we present a striking new finding that an ensemble of ne…
modelUncertainty-Informed Deep Learning Models Enable High-Confidence Predictions for Digital Histopathology
A model's ability to express its own predictive uncertainty is an essential attribute for maintaining clinical user confidence as computational biomarkers are deployed into real-world medical settings. In the domain of c…
AttributeUncertainty Quantificationwhole slide imagesOn Uncertainty Estimation by Tree-based Surrogate Models in Sequential Model-based Optimization
Sequential model-based optimization sequentially selects a candidate point by constructing a surrogate model with the history of evaluations, to solve a black-box optimization problem. Gaussian process (GP) regression is…