Deep Uncertainty Quantification: A Machine Learning Approach for Weather Forecasting
Weather forecasting is usually solved through numerical weather prediction (NWP), which can sometimes lead to unsatisfactory performance due to inappropriate setting of the initial states. In this paper, we design a data-driven method augmented by an effective information fusion mechanism to learn from historical data that incorporates prior knowledge from NWP. We cast the weather forecasting problem as an end-to-end deep learning problem and solve it by proposing a novel negative log-likelihood error (NLE) loss function. A notable advantage of our proposed method is that it simultaneously implements single-value forecasting and uncertainty quantification, which we refer to as deep uncertainty quantification (DUQ). Efficient deep ensemble strategies are also explored to further improve performance. This new approach was evaluated on a public dataset collected from weather stations in Beijing, China. Experimental results demonstrate that the proposed NLE loss significantly improves generalization compared to mean squared error (MSE) loss and mean absolute error (MAE) loss. Compared with NWP, this approach significantly improves accuracy by 47.76%, which is a state-of-the-art result on this benchmark dataset. The preliminary version of the proposed method won 2nd place in an online competition for daily weather forecasting.
Code (3)
Tasks
BIG-bench Machine LearningUncertainty QuantificationWeather ForecastingSimilar Papers 제목 키워드 기반
Uncertainty quantification for data-driven weather models
Artificial intelligence (AI)-based data-driven weather forecasting models have experienced rapid progress over the last years. Recent studies, with models trained on reanalysis data, achieve impressive results and demons…
Decision MakingUncertainty QuantificationWeather ForecastingCoDiCast: Conditional Diffusion Model for Global Weather Prediction with Uncertainty Quantification
Accurate weather forecasting is critical for science and society. Yet, existing methods have not managed to simultaneously have the properties of high accuracy, low uncertainty, and high computational efficiency. On one …
Computational EfficiencyDenoisingGPUUncertainty Quantification+1Graph-based Neural Space Weather Forecasting
Accurate space weather forecasting is crucial for protecting our increasingly digital infrastructure. Hybrid-Vlasov models, like Vlasiator, offer physical realism beyond that of current operational systems, but are too c…
Weather ForecastingPredicting Weather Uncertainty with Deep Convnets
Modern weather forecast models perform uncertainty quantification using ensemble prediction systems, which collect nonparametric statistics based on multiple perturbed simulations. To provide accurate estimation, dozens …
Uncertainty QuantificationWeather ForecastingSEEDS: Emulation of Weather Forecast Ensembles with Diffusion Models
Uncertainty quantification is crucial to decision-making. A prominent example is probabilistic forecasting in numerical weather prediction. The dominant approach to representing uncertainty in weather forecasting is to g…
Decision MakingDecision Making Under UncertaintyUncertainty QuantificationWeather Forecasting