paper-with-me

홈 › Papers

ADAF: An Artificial Intelligence Data Assimilation Framework for Weather Forecasting

2024-11-25 · Yanfei Xiang, Weixin Jin, Haiyu Dong, Mingliang Bai, Zuliang Fang, Pengcheng Zhao, Hongyu Sun, Kit Thambiratnam, Qi Zhang, Xiaomeng Huang

The forecasting skill of numerical weather prediction (NWP) models critically depends on the accurate initial conditions, also known as analysis, provided by data assimilation (DA). Traditional DA methods often face a trade-off between computational cost and accuracy due to complex linear algebra computations and the high dimensionality of the model, especially in nonlinear systems. Moreover, processing massive data in real-time requires substantial computational resources. To address this, we introduce an artificial intelligence-based data assimilation framework (ADAF) to generate high-quality kilometer-scale analysis. This study is the pioneering work using real-world observations from varied locations and multiple sources to verify the AI method's efficacy in DA, including sparse surface weather observations and satellite imagery. We implemented ADAF for four near-surface variables in the Contiguous United States (CONUS). The results indicate that ADAF surpasses the High Resolution Rapid Refresh Data Assimilation System (HRRRDAS) in accuracy by 16% to 33% for near-surface atmospheric conditions, aligning more closely with actual observations, and can effectively reconstruct extreme events, such as tropical cyclone wind fields. Sensitivity experiments reveal that ADAF can generate high-quality analysis even with low-accuracy backgrounds and extremely sparse surface observations. ADAF can assimilate massive observations within a three-hour window at low computational cost, taking about two seconds on an AMD MI200 graphics processing unit (GPU). ADAF has been shown to be efficient and effective in real-world DA, underscoring its potential role in operational weather forecasting.

📄 PDF Abstract BibTeX arXiv:2411.16807

Code (1)

xiangyanfei212/ADAF 공식 구현 pytorch

Tasks

GPUWeather Forecasting

Similar Papers 제목 키워드 기반

Advancing Ocean State Estimation with efficient and scalable AI

2025-11-08 · Yanfei Xiang, Yuan Gao, Hao Wu, Quan Zhang 외 arxiv

Accurate and efficient global ocean state estimation remains a grand challenge for Earth system science, hindered by the dual bottlenecks of computational scalability and degraded data fidelity in traditional data assimi…

Machine Learning, Deepest Learning: Statistical Data Assimilation Problems

2017-07-05 · Henry Abarbanel, Paul Rozdeba, Sasha Shirman

We formulate a strong equivalence between machine learning, artificial intelligence methods and the formulation of statistical data assimilation as used widely in physical and biological sciences. The correspondence is t…

BIG-bench Machine Learning

DAWP: A framework for global observation forecasting via Data Assimilation and Weather Prediction in satellite observation space

2025-10-13 · Junchao Gong, Jingyi Xu, Ben Fei, Fenghua Ling 외 arxiv

Weather prediction is a critical task for human society, where impressive progress has been made by training artificial intelligence weather prediction (AIWP) methods with reanalysis data. However, reliance on reanalysis…

Precipitation Forecasting

Artificial Intelligence to Enhance Mission Science Output for In-situ Observations: Dealing with the Sparse Data Challenge

2022-12-26 · M. I. Sitnov, G. K. Stephens, V. G. Merkin, C. -P. Wang 외

In the Earth's magnetosphere, there are fewer than a dozen dedicated probes beyond low-Earth orbit making in-situ observations at any given time. As a result, we poorly understand its global structure and evolution, the …

Ensemble data assimilation to diagnose AI-based weather prediction model: A case with ClimaX version 0.3.1

2024-07-25 · Shunji Kotsuki, Kenta Shiraishi, Atsushi Okazaki

Artificial intelligence (AI)-based weather prediction research is growing rapidly and has shown to be competitive with the advanced dynamic numerical weather prediction models. However, research combining AI-based weathe…

PredictionWeather Forecasting