paper-with-me

홈 › Papers

A review of predictive uncertainty estimation with machine learning

2022-09-17 · Hristos Tyralis, Georgia Papacharalampous

Predictions and forecasts of machine learning models should take the form of probability distributions, aiming to increase the quantity of information communicated to end users. Although applications of probabilistic prediction and forecasting with machine learning models in academia and industry are becoming more frequent, related concepts and methods have not been formalized and structured under a holistic view of the entire field. Here, we review the topic of predictive uncertainty estimation with machine learning algorithms, as well as the related metrics (consistent scoring functions and proper scoring rules) for assessing probabilistic predictions. The review covers a time period spanning from the introduction of early statistical (linear regression and time series models, based on Bayesian statistics or quantile regression) to recent machine learning algorithms (including generalized additive models for location, scale and shape, random forests, boosting and deep learning algorithms) that are more flexible by nature. The review of the progress in the field, expedites our understanding on how to develop new algorithms tailored to users' needs, since the latest advancements are based on some fundamental concepts applied to more complex algorithms. We conclude by classifying the material and discussing challenges that are becoming a hot topic of research.

📄 PDF Abstract BibTeX arXiv:2209.08307

Code (0)

등록된 구현이 없습니다.

Tasks

Additive modelsquantile regressionregressionTime SeriesTime Series Analysis

Similar Papers 제목 키워드 기반

Generative Model Predictive Control in Manufacturing Processes: A Review

2025-11-22 · Suk Ki Lee, Ronnie F. P. Stone, Max Gao, Wenlong Zhang 외 arxiv

Manufacturing processes are inherently dynamic and uncertain, with varying parameters and nonlinear behaviors, making robust control essential for maintaining quality and reliability. Traditional control methods often fa…

On Information-Theoretic Measures of Predictive Uncertainty

2024-10-14 · Kajetan Schweighofer, Lukas Aichberger, Mykyta Ielanskyi, Sepp Hochreiter

Reliable estimation of predictive uncertainty is crucial for machine learning applications, particularly in high-stakes scenarios where hedging against risks is essential. Despite its significance, a consensus on the cor…

Out-of-Distribution Detection

Measuring the Confidence of Traffic Forecasting Models: Techniques, Experimental Comparison and Guidelines towards Their Actionability

2022-10-28 · Ibai Laña, Ignacio, Olabarrieta, Javier Del Ser

The estimation of the amount of uncertainty featured by predictive machine learning models has acquired a great momentum in recent years. Uncertainty estimation provides the user with augmented information about the mode…

Management

Uncertainty Quantification in Probabilistic Machine Learning Models: Theory, Methods, and Insights

2025-09-07 · Marzieh Ajirak, Anand Ravishankar, Petar M. Djuric arxiv

Uncertainty Quantification (UQ) is essential in probabilistic machine learning models, particularly for assessing the reliability of predictions. In this paper, we present a systematic framework for estimating both epist…

Gaussian Processes

Exploring Prediction Uncertainty in Machine Translation Quality Estimation

2016-06-30 · CONLL 2016 8 · Daniel Beck, Lucia Specia, Trevor Cohn

Machine Translation Quality Estimation is a notoriously difficult task, which lessens its usefulness in real-world translation environments. Such scenarios can be improved if quality predictions are accompanied by a meas…

Machine TranslationPredictionTranslation