Data Assimilation with Machine Learning Surrogate Models: A Case Study with FourCastNet
Modern data-driven surrogate models for weather forecasting provide accurate short-term predictions but inaccurate and nonphysical long-term forecasts. This paper investigates online weather prediction using machine learning surrogates supplemented with partial and noisy observations. We empirically demonstrate and theoretically justify that, despite the long-time instability of the surrogates and the sparsity of the observations, filtering estimates can remain accurate in the long-time horizon. As a case study, we integrate FourCastNet, a weather surrogate model, within a variational data assimilation framework using partial, noisy ERA5 data. Our results show that filtering estimates remain accurate over a year-long assimilation window and provide effective initial conditions for forecasting tasks, including extreme event prediction.
Code (0)
등록된 구현이 없습니다.
Tasks
Weather ForecastingSimilar Papers 제목 키워드 기반
AI enhanced data assimilation and uncertainty quantification applied to Geological Carbon Storage
This study investigates the integration of machine learning (ML) and data assimilation (DA) techniques, focusing on implementing surrogate models for Geological Carbon Storage (GCS) projects while maintaining high fideli…
Uncertainty QuantificationCombining data assimilation and machine learning to emulate a dynamical model from sparse and noisy observations: a case study with the Lorenz 96 model
A novel method, based on the combination of data assimilation and machine learning is introduced. The new hybrid approach is designed for a two-fold scope: (i) emulating hidden, possibly chaotic, dynamics and (ii) predic…
BIG-bench Machine LearningRetrievalGeneralised Latent Assimilation in Heterogeneous Reduced Spaces with Machine Learning Surrogate Models
Reduced-order modelling and low-dimensional surrogate models generated using machine learning algorithms have been widely applied in high-dimensional dynamical systems to improve the algorithmic efficiency. In this paper…
BIG-bench Machine LearningImproving Surrogate Model Robustness to Perturbations for Dynamical Systems Through Machine Learning and Data Assimilation
Many real-world systems are modelled using complex ordinary differential equations (ODEs). However, the dimensionality of these systems can make them challenging to analyze. Dimensionality reduction techniques like Prope…
Dimensionality ReductionComposing a surrogate observation operator for sequential data assimilation
In data assimilation, state estimation is not straightforward when the observation operator is unknown. This study proposes a method for composing a surrogate operator when the true operator is unknown. A neural network …
State Estimation