paper-with-me

홈 › Papers

Uncertainty Principles in Risk-Aware Statistical Estimation

2021-04-29 · Nikolas P. Koumpis, Dionysios S. Kalogerias

We present a new uncertainty principle for risk-aware statistical estimation, effectively quantifying the inherent trade-off between mean squared error ($\mse$) and risk, the latter measured by the associated average predictive squared error variance ($\sev$), for every admissible estimator of choice. Our uncertainty principle has a familiar form and resembles fundamental and classical results arising in several other areas, such as the Heisenberg principle in statistical and quantum mechanics, and the Gabor limit (time-scale trade-offs) in harmonic analysis. In particular, we prove that, provided a joint generative model of states and observables, the product between $\mse$ and $\sev$ is bounded from below by a computable model-dependent constant, which is explicitly related to the Pareto frontier of a recently studied $\sev$-constrained minimum $\mse$ (MMSE) estimation problem. Further, we show that the aforementioned constant is inherently connected to an intuitive new and rigorously topologically grounded statistical measure of distribution skewness in multiple dimensions, consistent with Pearson's moment coefficient of skewness for variables on the line. Our results are also illustrated via numerical simulations.

📄 PDF Abstract BibTeX arXiv:2104.14283

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Uncertainty in Machine Learning

2025-10-07 · Hans Weytjens, Wouter Verbeke arxiv

This book chapter introduces the principles and practical applications of uncertainty quantification in machine learning. It explains how to identify and distinguish between different types of uncertainty and presents me…

Distribution-Free Risk-Aware Planning and Control Under Uncertainty Using Conformal Spectral Risk Control

2026-06-02 · Junsik Eom, Tulga Ersal arxiv

Safe navigation in dynamic and uncertain environments often relies on accurate estimation of, or assumptions about, the true underlying uncertainty. However, accurately characterizing the true uncertainty distribution is…

From Group-Differences to Single-Subject Probability: Conformal Prediction-based Uncertainty Estimation for Brain-Age Modeling

2023-02-10 · Jan Ernsting, Nils R. Winter, Ramona Leenings, Kelvin Sarink 외

The brain-age gap is one of the most investigated risk markers for brain changes across disorders. While the field is progressing towards large-scale models, recently incorporating uncertainty estimates, no model to date…

Conformal Prediction

Statistical Estimation: From Denoising to Sparse Regression and Hidden Cliques

2014-09-19 · Eric W. Tramel, Santhosh Kumar, Andrei Giurgiu, Andrea Montanari

These notes review six lectures given by Prof. Andrea Montanari on the topic of statistical estimation for linear models. The first two lectures cover the principles of signal recovery from linear measurements in terms o…

Denoisingregression

Risk-aware Classification via Uncertainty Quantification

2024-12-04 · Murat Sensoy, Lance M. Kaplan, Simon Julier, Maryam Saleki 외

Autonomous and semi-autonomous systems are using deep learning models to improve decision-making. However, deep classifiers can be overly confident in their incorrect predictions, a major issue especially in safety-criti…

ClassificationDecision MakingDeep LearningUncertainty Quantification+1