paper-with-me

Papers

Large width penalization for neural network-based prediction interval estimation

2024-11-28 · Worachit Amnuaypongsa, Jitkomut Songsiri

Forecasting accuracy in highly uncertain environments is challenging due to the stochastic nature of systems. Deterministic forecasting provides only point estimates and cannot capture potential outcomes. Therefore, probabilistic forecasting has gained significant attention due to its ability to quantify uncertainty, where one of the approaches is to express it as a prediction interval (PI), that explicitly shows upper and lower bounds of predictions associated with a confidence level. High-quality PI is characterized by a high PI coverage probability (PICP) and a narrow PI width. In many real-world applications, the PI width is generally used in risk management to prepare resources that improve reliability and effectively manage uncertainty. A wider PI width results in higher costs for backup resources as decision-making processes often focus on the worst-case scenarios arising with large PI widths under extreme conditions. This study aims to reduce the large PI width from the PI estimation method by proposing a new PI loss function that penalizes the average of the large PI widths more heavily. The proposed formulation is compatible with gradient-based algorithms, the standard approach to training neural networks (NNs), and integrating state-of-the-art NNs and existing deep learning techniques. Experiments with the synthetic dataset reveal that our formulation significantly reduces the large PI width while effectively maintaining the PICP to achieve the desired probability. The practical implementation of our proposed loss function is demonstrated in solar irradiance forecasting, highlighting its effectiveness in minimizing the large PI width in data with high uncertainty and showcasing its compatibility with more complex neural network models. Therefore, reducing large PI widths from our method can lead to significant cost savings by over-allocation of reserve resources.

📄 PDF Abstract BibTeX arXiv:2411.19181

Code (1)

energyCUEE/PIestim_sumk 공식 구현 pytorch

Tasks

Solar Irradiance Forecasting

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Focus 설명 없음

Similar Papers 제목 키워드 기반

Benchmarking Machine Learning Uncertainty Quantification Methodologies for Predicting Turbine Gas Temperature Degradation

2026-05-28 · Jostein Barry-Straume, Changmin Son, Adrian Sandu, Gavan Burke 외 arxiv

Effective prognostics and health management of modern engines relies on accurate turbine gas temperature predictions and robust uncertainty quantification to ensure reliability and safety. This paper investigates five ma…

Tube Loss: A Novel Approach for Prediction Interval Estimation and probabilistic forecasting

2024-12-08 · Pritam Anand, Tathagata Bandyopadhyay, Suresh Chandra

This paper proposes a novel loss function, called 'Tube Loss', for simultaneous estimation of bounds of a Prediction Interval (PI) in the regression setup. The PIs obtained by minimizing the empirical risk based on the T…

Conformal Prediction

Adaptive Individual Uncertainty under Out-Of-Distribution Shift with Expert-Routed Conformal Prediction

2025-10-17 · Amitesh Badkul, Lei Xie arxiv

Reliable, informative, and individual uncertainty quantification (UQ) remains missing in current ML community. This hinders the effective application of AI/ML to risk-sensitive domains. Most methods either fail to provid…

Drug Discovery

Tight Prediction Intervals Using Expanded Interval Minimization

2018-06-28 · Dongqi Su, Ying Yin Ting, Jason Ansel

Prediction intervals are a valuable way of quantifying uncertainty in regression problems. Good prediction intervals should be both correct, containing the actual value between the lower and upper bound at least a target…

PredictionPrediction Intervals

Uncertainty Quantification of the Virial Black Hole Mass with Conformal Prediction

2023-07-11 · Suk Yee Yong, Cheng Soon Ong

Precise measurements of the black hole mass are essential to gain insight on the black hole and host galaxy co-evolution. A direct measure of the black hole mass is often restricted to nearest galaxies and instead, an in…

Conformal PredictionPredictionPrediction Intervalsquantile regression+1