paper-with-me

Papers

Probabilistic Forecasting with Generative Networks via Scoring Rule Minimization

2021-12-15 · Lorenzo Pacchiardi, Rilwan Adewoyin, Peter Dueben, Ritabrata Dutta

Probabilistic forecasting relies on past observations to provide a probability distribution for a future outcome, which is often evaluated against the realization using a scoring rule. Here, we perform probabilistic forecasting with generative neural networks, which parametrize distributions on high-dimensional spaces by transforming draws from a latent variable. Generative networks are typically trained in an adversarial framework. In contrast, we propose to train generative networks to minimize a predictive-sequential (or prequential) scoring rule on a recorded temporal sequence of the phenomenon of interest, which is appealing as it corresponds to the way forecasting systems are routinely evaluated. Adversarial-free minimization is possible for some scoring rules; hence, our framework avoids the cumbersome hyperparameter tuning and uncertainty underestimation due to unstable adversarial training, thus unlocking reliable use of generative networks in probabilistic forecasting. Further, we prove consistency of the minimizer of our objective with dependent data, while adversarial training assumes independence. We perform simulation studies on two chaotic dynamical models and a benchmark data set of global weather observations; for this last example, we define scoring rules for spatial data by drawing from the relevant literature. Our method outperforms state-of-the-art adversarial approaches, especially in probabilistic calibration, while requiring less hyperparameter tuning.

📄 PDF Abstract BibTeX arXiv:2112.08217

Code (1)

LoryPack/GenerativeNetworksScoringRulesProbabilisticForecasting 공식 구현 pytorch

Tasks

scoring ruleUncertainty QuantificationWeather Forecasting

Similar Papers 제목 키워드 기반

Signature Kernel Scoring Rule: A Spatio-Temporal Diagnostic for Probabilistic Weather Forecasting

2025-10-21 · Archer Dodson, Ritabrata Dutta arxiv

Modern weather forecasting has increasingly transitioned from numerical weather prediction (NWP) to data-driven machine learning forecasting techniques. While these new models produce probabilistic forecasts to quantify …

Weather Forecasting

Decision-Aware Training for Sample-Based Generative Models

2026-07-01 · Kornelius Raeth, Nicole Ludwig arxiv

Sample-based generative models are increasingly used for probabilistic forecasting in high-stakes decision settings, yet their training objectives are blind to the decision maker's cost structure. These models are common…

Probabilistic Self-supervised Learning via Scoring Rules Minimization

2023-09-05 · Amirhossein Vahidi, Simon Schoßer, Lisa Wimmer, Yawei Li 외

In this paper, we propose a novel probabilistic self-supervised learning via Scoring Rule Minimization (ProSMIN), which leverages the power of probabilistic models to enhance representation quality and mitigate collapsin…

Knowledge DistillationOut-of-Distribution Detectionscoring ruleSelf-Supervised Learning+1

Regions of Reliability in the Evaluation of Multivariate Probabilistic Forecasts

2023-04-19 · Étienne Marcotte, Valentina Zantedeschi, Alexandre Drouin, Nicolas Chapados

Multivariate probabilistic time series forecasts are commonly evaluated via proper scoring rules, i.e., functions that are minimal in expectation for the ground-truth distribution. However, this property is not sufficien…

scoring ruleTime SeriesTime Series Forecasting

Multivariate Forecasting Evaluation: On Sensitive and Strictly Proper Scoring Rules

2019-10-16 · Florian Ziel, Kevin Berk

In recent years, probabilistic forecasting is an emerging topic, which is why there is a growing need of suitable methods for the evaluation of multivariate predictions. We analyze the sensitivity of the most common scor…

scoring rule