Uncertainty quantification for distributed regression
The ever-growing size of the datasets renders well-studied learning techniques, such as Kernel Ridge Regression, inapplicable, posing a serious computational challenge. Divide-and-conquer is a common remedy, suggesting to split the dataset into disjoint partitions, obtain the local estimates and average them, it allows to scale-up an otherwise ineffective base approach. In the current study we suggest a fully data-driven approach to quantify uncertainty of the averaged estimator. Namely, we construct simultaneous element-wise confidence bands for the predictions yielded by the averaged estimator on a given deterministic prediction set. The novel approach features rigorous theoretical guaranties for a wide class of base learners with Kernel Ridge regression being a special case. As a by-product of our analysis we also obtain a sup-norm consistency result for the divide-and-conquer Kernel Ridge Regression. The simulation study supports the theoretical findings.
Code (0)
등록된 구현이 없습니다.
Tasks
regressionUncertainty QuantificationSimilar Papers 제목 키워드 기반
Improved uncertainty quantification for neural networks with Bayesian last layer
Uncertainty quantification is an important task in machine learning - a task in which standardneural networks (NNs) have traditionally not excelled. This can be a limitation for safety-critical applications, where uncert…
Gaussian ProcessesregressionUncertainty QuantificationVariational InferenceA framework for benchmarking uncertainty in deep regression
We propose a framework for the assessment of uncertainty quantification in deep regression. The framework is based on regression problems where the regression function is a linear combination of nonlinear functions. Basi…
BenchmarkingregressionUncertainty QuantificationAn Axiomatic Assessment of Entropy- and Variance-based Uncertainty Quantification in Regression
Uncertainty quantification (UQ) is crucial in machine learning, yet most (axiomatic) studies of uncertainty measures focus on classification, leaving a gap in regression settings with limited formal justification and eva…
regressionUncertainty QuantificationBayesian meta learning for trustworthy uncertainty quantification
We consider the problem of Bayesian regression with trustworthy uncertainty quantification. We define that the uncertainty quantification is trustworthy if the ground truth can be captured by intervals dependent on the p…
Meta-LearningregressionUncertainty QuantificationConformalized-DeepONet: A Distribution-Free Framework for Uncertainty Quantification in Deep Operator Networks
In this paper, we adopt conformal prediction, a distribution-free uncertainty quantification (UQ) framework, to obtain confidence prediction intervals with coverage guarantees for Deep Operator Network (DeepONet) regress…
Conformal PredictionPredictionPrediction Intervalsregression+1