Sonny: Breaking the Compute Wall in Medium-Range Weather Forecasting
Weather forecasting is a fundamental problem for protecting lives and infrastructure from high-impact atmospheric events. Recently, data-driven weather forecasting methods based on deep learning have demonstrated strong performance, often reaching accuracy levels competitive with operational numerical systems. However, many existing models rely on large-scale training regimes and compute-intensive architectures, which raises the practical barrier for academic groups with limited compute resources. Here we introduce Sonny, an efficient hierarchical transformer that achieves competitive medium-range forecasting performance while remaining feasible within reasonable compute budgets. At the core of Sonny is a two-stage StepsNet design: a narrow slow path first models large-scale atmospheric dynamics, and a subsequent full-width fast path integrates thermodynamic interactions. To stabilize medium-range rollout without an additional fine-tuning stage, we apply exponential moving average (EMA) during training. On WeatherBench2, Sonny yields robust medium-range forecast skill, remains competitive with operational baselines, and demonstrates clear advantages over FastNet, particularly at extended tropical lead times. In practice, Sonny can be trained to convergence on a single NVIDIA A40 GPU in approximately 5.5 days.
Code (0)
등록된 구현이 없습니다.
Tasks
Weather ForecastingSimilar Papers 제목 키워드 기반
Through-the-Wall Radar under Electromagnetic Complex Wall: A Deep Learning Approach
This paper employed deep learning to do two-dimensional, multi-target locating in Through-the-Wall Radar under conditions where the wall is treated as a complex electromagnetic medium. We made five assumptions about the …
Deep LearningBreaking On-device Training Memory Wall: A Systematic Survey
On-device training has become an increasingly popular approach to machine learning, enabling models to be trained directly on mobile and edge devices. However, a major challenge in this area is the limited memory availab…
NavigateSurveyNumerical models outperform AI weather forecasts of record-breaking extremes
Artificial intelligence (AI)-based models are revolutionizing weather forecasting and have surpassed leading numerical weather prediction systems on various benchmark tasks. However, their ability to extrapolate and reli…
Weather ForecastingLearning to Customize Network Security Rules
Security is a major concern for organizations who wish to leverage cloud computing. In order to reduce security vulnerabilities, public cloud providers offer firewall functionalities. When properly configured, a firewall…
BlockingCloud ComputingFinite-word-length FPGA implementation of model predictive control for ITER resistive wall mode control
In advanced tokamak scenarios, active feedback control of unstable resistive wall modes (RWM) may be required. A RWM is an instability due to plasma kink at higher plasma pressure, moderated by the presence of a resistiv…
Model Predictive Control