paper-with-me

홈 › Papers

climt-paraformer: Stable Emulation of Convective Parameterization using a Temporal Memory-aware Transformer

2026-04-22 · Shuochen Wang, Nishant Yadav, Joy Merwin Monteiro, Auroop R. Ganguly arxiv

Accurate representation of moist convective sub-grid-scale processes remains a major challenge in global climate models, as traditional parameterization schemes are both computationally expensive and difficult to scale. Neural network (NN) emulators offer a promising alternative by learning efficient mappings between atmospheric states and convective tendencies while retaining fidelity to the underlying physics. However, most existing NN-based parameterizations are memory-less and rely only on instantaneous inputs, even though convection evolves over time and depends on prior atmospheric states. Recent studies have begun to incorporate convective memory, but they often treat past states as independent features rather than modeling temporal dependencies explicitly. In this work, we develop a temporal memory-aware Transformer emulator for the Emanuel convective parameterization and evaluate it in a single-column climate model (SCM) under both offline and online configurations. The Transformer captures temporal correlations and nonlinear interactions across consecutive atmospheric states. Compared with baseline emulators, including a memory-less multilayer perceptron and a recurrent long short-term memory model, the Transformer achieves lower offline errors. Sensitivity analysis indicates that a memory length of approximately 100 minutes yields the best performance, whereas longer memory degrades performance. We further test the emulator in long-term coupled simulations and show that it remains stable over 10 years. Overall, this study demonstrates the importance of explicit temporal modeling for NN-based parameterizations.

📄 PDF Abstract BibTeX arXiv:2604.21085

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Paraformer: Parameterization of Sub-grid Scale Processes Using Transformers

2024-12-21 · Shuochen Wang, Nishant Yadav, Auroop R. Ganguly

One of the major sources of uncertainty in the current generation of Global Climate Models (GCMs) is the representation of sub-grid scale physical processes. Over the years, a series of deep-learning-based parameterizati…

Deep Learning

Scaling Storm-Resolving Atmospheric AI Simulation to the Entire Planet

2026-06-30 · Zeyuan Hu, Akshay Subramaniam, Noel Keen, Tao Ge 외 arxiv

Kilometer-scale convection shapes precipitation extremes, tropical organization, and cloud feedbacks, but most global atmospheric models approximate these processes at 25-100 km resolution. Global storm-resolving physics…

Paraformer-v2: An improved non-autoregressive transformer for noise-robust speech recognition

2024-09-26 · Keyu An, Zerui Li, Zhifu Gao, Shiliang Zhang

Attention-based encoder-decoder, e.g. transformer and its variants, generates the output sequence in an autoregressive (AR) manner. Despite its superior performance, AR model is computationally inefficient as its generat…

DecoderRobust Speech Recognitionspeech-recognitionSpeech Recognition

Kilometer-Scale Convection Allowing Model Emulation using Generative Diffusion Modeling

2024-08-20 · Jaideep Pathak, Yair Cohen, Piyush Garg, Peter Harrington 외

Storm-scale convection-allowing models (CAMs) are an important tool for predicting the evolution of thunderstorms and mesoscale convective systems that result in damaging extreme weather. By explicitly resolving convecti…

Weather Forecasting

ParaFormer: Parallel Attention Transformer for Efficient Feature Matching

2023-03-02 · Xiaoyong Lu, Yaping Yan, Bin Kang, Songlin Du

Heavy computation is a bottleneck limiting deep-learningbased feature matching algorithms to be applied in many realtime applications. However, existing lightweight networks optimized for Euclidean data cannot address cl…

Homography EstimationPose Estimation