paper-with-me

Papers

DiffDA: a Diffusion Model for Weather-scale Data Assimilation

2024-01-11 · Langwen Huang, Lukas Gianinazzi, Yuejiang Yu, Peter D. Dueben, Torsten Hoefler

The generation of initial conditions via accurate data assimilation is crucial for weather forecasting and climate modeling. We propose DiffDA as a denoising diffusion model capable of assimilating atmospheric variables using predicted states and sparse observations. Acknowledging the similarity between a weather forecast model and a denoising diffusion model dedicated to weather applications, we adapt the pretrained GraphCast neural network as the backbone of the diffusion model. Through experiments based on simulated observations from the ERA5 reanalysis dataset, our method can produce assimilated global atmospheric data consistent with observations at 0.25 deg (~30km) resolution globally. This marks the highest resolution achieved by ML data assimilation models. The experiments also show that the initial conditions assimilated from sparse observations (less than 0.96% of gridded data) and 48-hour forecast can be used for forecast models with a loss of lead time of at most 24 hours compared to initial conditions from state-of-the-art data assimilation in ERA5. This enables the application of the method to real-world applications, such as creating reanalysis datasets with autoregressive data assimilation.

📄 PDF Abstract BibTeX arXiv:2401.05932

Code (1)

spcl/diffda 공식 구현 jax

Tasks

DenoisingWeather Forecasting

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Generative Data Assimilation of Sparse Weather Station Observations at Kilometer Scales

2024-06-19 · Peter Manshausen, Yair Cohen, Peter Harrington, Jaideep Pathak 외

Data assimilation of observational data into full atmospheric states is essential for weather forecast model initialization. Recently, methods for deep generative data assimilation have been proposed which allow for usin…

Diffusion-Based Data Augmentation for Image Recognition: A Systematic Analysis and Evaluation

2026-03-09 · Zekun Li, Yinghuan Shi, Yang Gao, Dong Xu arxiv

Diffusion-based data augmentation (DiffDA) has emerged as a promising approach to improving classification performance under data scarcity. However, existing works vary significantly in task configurations, model choices…

Data Augmentation

DiffDance: Cascaded Human Motion Diffusion Model for Dance Generation

2023-08-05 · Qiaosong Qi, Le Zhuo, Aixi Zhang, Yue Liao 외

When hearing music, it is natural for people to dance to its rhythm. Automatic dance generation, however, is a challenging task due to the physical constraints of human motion and rhythmic alignment with target music. Co…

Representation LearningRhythmSuper-Resolution

Appa: Bending Weather Dynamics with Latent Diffusion Models for Global Data Assimilation

2025-04-25 · Gérôme Andry, François Rozet, Sacha Lewin, Omer Rochman 외

Deep learning has transformed weather forecasting by improving both its accuracy and computational efficiency. However, before any forecast can begin, weather centers must identify the current atmospheric state from vast…

Computational EfficiencyWeather Forecasting

Training-Free Data Assimilation with GenCast

2025-09-23 · Thomas Savary, François Rozet, Gilles Louppe arxiv

Data assimilation is widely used in many disciplines such as meteorology, oceanography, and robotics to estimate the state of a dynamical system from noisy observations. In this work, we propose a lightweight and general…