paper-with-me

Papers

FengWu: Pushing the Skillful Global Medium-range Weather Forecast beyond 10 Days Lead

2023-04-06 · Kang Chen, Tao Han, Junchao Gong, Lei Bai, Fenghua Ling, Jing-Jia Luo, Xi Chen, Leiming Ma, Tianning Zhang, Rui Su, Yuanzheng Ci, Bin Li, Xiaokang Yang, Wanli Ouyang

We present FengWu, an advanced data-driven global medium-range weather forecast system based on Artificial Intelligence (AI). Different from existing data-driven weather forecast methods, FengWu solves the medium-range forecast problem from a multi-modal and multi-task perspective. Specifically, a deep learning architecture equipped with model-specific encoder-decoders and cross-modal fusion Transformer is elaborately designed, which is learned under the supervision of an uncertainty loss to balance the optimization of different predictors in a region-adaptive manner. Besides this, a replay buffer mechanism is introduced to improve medium-range forecast performance. With 39-year data training based on the ERA5 reanalysis, FengWu is able to accurately reproduce the atmospheric dynamics and predict the future land and atmosphere states at 37 vertical levels on a 0.25{\deg} latitude-longitude resolution. Hindcasts of 6-hourly weather in 2018 based on ERA5 demonstrate that FengWu performs better than GraphCast in predicting 80\% of the 880 reported predictands, e.g., reducing the root mean square error (RMSE) of 10-day lead global z500 prediction from 733 to 651 $m^{2}/s^2$. In addition, the inference cost of each iteration is merely 600ms on NVIDIA Tesla A100 hardware. The results suggest that FengWu can significantly improve the forecast skill and extend the skillful global medium-range weather forecast out to 10.75 days lead (with ACC of z500 > 0.6) for the first time.

📄 PDF Abstract BibTeX arXiv:2304.02948

Code (2)

OpenEarthLab/FengWu
PaddlePaddle/PaddleScience paddle

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Adam 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Similar Papers 제목 키워드 기반

Towards an end-to-end artificial intelligence driven global weather forecasting system

2023-12-18 · Kun Chen, Lei Bai, Fenghua Ling, Peng Ye 외

The weather forecasting system is important for science and society, and significant achievements have been made in applying artificial intelligence (AI) to medium-range weather forecasting. However, existing AI-based we…

Weather Forecasting

FengWu-GHR: Learning the Kilometer-scale Medium-range Global Weather Forecasting

2024-01-28 · Tao Han, Song Guo, Fenghua Ling, Kang Chen 외

Kilometer-scale modeling of global atmosphere dynamics enables fine-grained weather forecasting and decreases the risk of disastrous weather and climate activity. Therefore, building a kilometer-scale global forecast mod…

Weather Forecasting

FengWu-4DVar: Coupling the Data-driven Weather Forecasting Model with 4D Variational Assimilation

2023-12-16 · Yi Xiao, Lei Bai, Wei Xue, Kang Chen 외

Weather forecasting is a crucial yet highly challenging task. With the maturity of Artificial Intelligence (AI), the emergence of data-driven weather forecasting models has opened up a new paradigm for the development of…

Weather Forecasting

GraphCast: Learning skillful medium-range global weather forecasting

2022-12-24 · Remi Lam, Alvaro Sanchez-Gonzalez, Matthew Willson, Peter Wirnsberger 외

Global medium-range weather forecasting is critical to decision-making across many social and economic domains. Traditional numerical weather prediction uses increased compute resources to improve forecast accuracy, but …

Decision MakingWeather Forecasting

FengWu-W2S: A deep learning model for seamless weather-to-subseasonal forecast of global atmosphere

2024-11-15 · Fenghua Ling, Kang Chen, Jiye Wu, Tao Han 외

Seamless forecasting that produces warning information at continuum timescales based on only one system is a long-standing pursuit for weather-climate service. While the rapid advancement of deep learning has induced rev…