paper-with-me

홈 › Papers

VAE-Var: Variational-Autoencoder-Enhanced Variational Assimilation

2024-05-22 · Yi Xiao, Qilong Jia, Wei Xue, Lei Bai

Data assimilation refers to a set of algorithms designed to compute the optimal estimate of a system's state by refining the prior prediction (known as background states) using observed data. Variational assimilation methods rely on the maximum likelihood approach to formulate a variational cost, with the optimal state estimate derived by minimizing this cost. Although traditional variational methods have achieved great success and have been widely used in many numerical weather prediction centers, they generally assume Gaussian errors in the background states, which limits the accuracy of these algorithms due to the inherent inaccuracies of this assumption. In this paper, we introduce VAE-Var, a novel variational algorithm that leverages a variational autoencoder (VAE) to model a non-Gaussian estimate of the background error distribution. We theoretically derive the variational cost under the VAE estimation and present the general formulation of VAE-Var; we implement VAE-Var on low-dimensional chaotic systems and demonstrate through experimental results that VAE-Var consistently outperforms traditional variational assimilation methods in terms of accuracy across various observational settings.

📄 PDF Abstract BibTeX arXiv:2405.13711

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Attention-based Convolutional Autoencoders for 3D-Variational Data Assimilation

2021-01-06 · Julian Mack, Rossella Arcucci, Miguel Molina-Solana, Yi-Ke Guo

We propose a new 'Bi-Reduced Space' approach to solving 3D Variational Data Assimilation using Convolutional Autoencoders. We prove that our approach has the same solution as previous methods but has significantly lower …

Analog ensemble data assimilation and a method for constructing analogs with variational autoencoders

2020-06-01 · Ian Grooms

It is proposed to use analogs of the forecast mean to generate an ensemble of perturbations for use in ensemble optimal interpolation (EnOI) or ensemble variational (EnVar) methods. A new method of constructing analogs u…

Physics-enhanced Gaussian Process Variational Autoencoder

2023-05-15 · Thomas Beckers, Qirui Wu, George J. Pappas

Variational autoencoders allow to learn a lower-dimensional latent space based on high-dimensional input/output data. Using video clips as input data, the encoder may be used to describe the movement of an object in the …

Learning Variational Data Assimilation Models and Solvers

2020-07-25 · Ronan Fablet, Bertrand Chapron, Lucas. Drumetz, Etienne Memin 외

This paper addresses variational data assimilation from a learning point of view. Data assimilation aims to reconstruct the time evolution of some state given a series of observations, possibly noisy and irregularly-samp…

TorchDA: A Python package for performing data assimilation with deep learning forward and transformation functions

2024-08-30 · Sibo Cheng, Jinyang Min, Che Liu, Rossella Arcucci

Data assimilation techniques are often confronted with challenges handling complex high dimensional physical systems, because high precision simulation in complex high dimensional physical systems is computationally expe…

Deep Learning