Exploring Design Choices for Autoregressive Deep Learning Climate Models
Deep Learning models have achieved state-of-the-art performance in medium-range weather prediction but often fail to maintain physically consistent rollouts beyond 14 days. In contrast, a few atmospheric models demonstrate stability over decades, though the key design choices enabling this remain unclear. This study quantitatively compares the long-term stability of three prominent DL-MWP architectures - FourCastNet, SFNO, and ClimaX - trained on ERA5 reanalysis data at 5.625{\deg} resolution. We systematically assess the impact of autoregressive training steps, model capacity, and choice of prognostic variables, identifying configurations that enable stable 10-year rollouts while preserving the statistical properties of the reference dataset. Notably, rollouts with SFNO exhibit the greatest robustness to hyperparameter choices, yet all models can experience instability depending on the random seed and the set of prognostic variables
Code (1)
Tasks
Deep LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Autoregressive Renaissance in Neural PDE Solvers
Recent developments in the field of neural partial differential equation (PDE) solvers have placed a strong emphasis on neural operators. However, the paper "Message Passing Neural PDE Solver" by Brandstetter et al. publ…
Graph Neural NetworkMachine Learning Workflows in Climate Modeling: Design Patterns and Insights from Case Studies
Machine learning has been increasingly applied in climate modeling on system emulation acceleration, data-driven parameter inference, forecasting, and knowledge discovery, addressing challenges such as physical consisten…
Transfer LearningArchesClimate: Probabilistic Decadal Ensemble Generation With Flow Matching
Internal variability is a dominant contributor to the uncertainty of predictions at the interannual to decadal timescale. A typical approach to separating the internal variability from forced climate responses is to gene…
Exploring Monetary Policy Shocks with Large-Scale Bayesian VARs
I introduce a high-dimensional Bayesian vector autoregressive (BVAR) framework designed to estimate the effects of conventional monetary policy shocks. The model captures structural shocks as latent factors, enabling com…
GUD: Generation with Unified Diffusion
Diffusion generative models transform noise into data by inverting a process that progressively adds noise to data samples. Inspired by concepts from the renormalization group in physics, which analyzes systems across di…
Scheduling