Threshold Martingales and the Evolution of Forecasts
This paper introduces a martingale that characterizes two properties of evolving forecast distributions. Ideal forecasts of a future event behave as martingales, sequen- tially updating the forecast to leverage the available information as the future event approaches. The threshold martingale introduced here measures the proportion of the forecast distribution lying below a threshold. In addition to being calibrated, a threshold martingale has quadratic variation that accumulates to a total determined by a quantile of the initial forecast distribution. Deviations from calibration or to- tal volatility signal problems in the underlying model. Calibration adjustments are well-known, and we augment these by introducing a martingale filter that improves volatility while guaranteeing smaller mean squared error. Thus, post-processing can rectify problems with calibration and volatility without revisiting the original forecast- ing model. We apply threshold martingales first to forecasts from simulated models and then to models that predict the winner in professional basketball games.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Description of Incomplete Financial Markets for the Discrete Time Evolution of Risk Assets
In the paper, the martingales and super-martingales relative to a regular set of measures are systematically studied. The notion of local regular super-martingale relative to a set of equivalent measures is introduced an…
A Cardinal Comparison of Experts
In various situations, decision makers face experts that may provide conflicting advice. This advice may be in the form of probabilistic forecasts over critical future events. We consider a setting where the two forecast…
Assessing and Comparing Fixed-Target Forecasts of Arctic Sea Ice: Glide Charts for Feature-Engineered Linear Regression and Machine Learning Models
We use "glide charts" (plots of sequences of root mean squared forecast errors as the target date is approached) to evaluate and compare fixed-target forecasts of Arctic sea ice. We first use them to evaluate the simple …
A unified view of LIBOR models
We provide a unified framework for modeling LIBOR rates using general semimartingales as driving processes and generic functional forms to describe the evolution of the dynamics. We derive sufficient conditions for the m…
An Imbalance-Robust Evaluation Framework for Extreme Risk Forecasts
Evaluating rare-event forecasts is challenging because standard metrics collapse as event prevalence declines. Measures such as F1-score, AUPRC, MCC, and accuracy induce degenerate thresholds -- converging to zero or one…