paper-with-me

홈 › Papers

Sonny: Breaking the Compute Wall in Medium-Range Weather Forecasting

2026-03-22 · Minjong Cheon arxiv

Weather forecasting is a fundamental problem for protecting lives and infrastructure from high-impact atmospheric events. Recently, data-driven weather forecasting methods based on deep learning have demonstrated strong performance, often reaching accuracy levels competitive with operational numerical systems. However, many existing models rely on large-scale training regimes and compute-intensive architectures, which raises the practical barrier for academic groups with limited compute resources. Here we introduce Sonny, an efficient hierarchical transformer that achieves competitive medium-range forecasting performance while remaining feasible within reasonable compute budgets. At the core of Sonny is a two-stage StepsNet design: a narrow slow path first models large-scale atmospheric dynamics, and a subsequent full-width fast path integrates thermodynamic interactions. To stabilize medium-range rollout without an additional fine-tuning stage, we apply exponential moving average (EMA) during training. On WeatherBench2, Sonny yields robust medium-range forecast skill, remains competitive with operational baselines, and demonstrates clear advantages over FastNet, particularly at extended tropical lead times. In practice, Sonny can be trained to convergence on a single NVIDIA A40 GPU in approximately 5.5 days.

📄 PDF Abstract BibTeX arXiv:2603.21284

Code (0)

등록된 구현이 없습니다.

Tasks

Weather Forecasting

Similar Papers 제목 키워드 기반

Through-the-Wall Radar under Electromagnetic Complex Wall: A Deep Learning Approach

2021-02-16 · Fardin Ghorbani, Hossein Soleimani

This paper employed deep learning to do two-dimensional, multi-target locating in Through-the-Wall Radar under conditions where the wall is treated as a complex electromagnetic medium. We made five assumptions about the …

Deep Learning

Breaking On-device Training Memory Wall: A Systematic Survey

2023-06-17 · Shitian Li, Chunlin Tian, Kahou Tam, Rui Ma 외

On-device training has become an increasingly popular approach to machine learning, enabling models to be trained directly on mobile and edge devices. However, a major challenge in this area is the limited memory availab…

NavigateSurvey

Numerical models outperform AI weather forecasts of record-breaking extremes

2025-08-21 · Zhongwei Zhang, Erich Fischer, Jakob Zscheischler, Sebastian Engelke arxiv

Artificial intelligence (AI)-based models are revolutionizing weather forecasting and have surpassed leading numerical weather prediction systems on various benchmark tasks. However, their ability to extrapolate and reli…

Weather Forecasting

Learning to Customize Network Security Rules

2017-12-28 · Michael Bargury, Roy Levin, Royi Ronen

Security is a major concern for organizations who wish to leverage cloud computing. In order to reduce security vulnerabilities, public cloud providers offer firewall functionalities. When properly configured, a firewall…

BlockingCloud Computing

Finite-word-length FPGA implementation of model predictive control for ITER resistive wall mode control

2021-03-18 · Samo Gerkšič, Boštjan Pregelj

In advanced tokamak scenarios, active feedback control of unstable resistive wall modes (RWM) may be required. A RWM is an instability due to plasma kink at higher plasma pressure, moderated by the presence of a resistiv…

Model Predictive Control