paper-with-me

Papers

TorchDA: A Python package for performing data assimilation with deep learning forward and transformation functions

2024-08-30 · Sibo Cheng, Jinyang Min, Che Liu, Rossella Arcucci

Data assimilation techniques are often confronted with challenges handling complex high dimensional physical systems, because high precision simulation in complex high dimensional physical systems is computationally expensive and the exact observation functions that can be applied in these systems are difficult to obtain. It prompts growing interest in integrating deep learning models within data assimilation workflows, but current software packages for data assimilation cannot handle deep learning models inside. This study presents a novel Python package seamlessly combining data assimilation with deep neural networks to serve as models for state transition and observation functions. The package, named TorchDA, implements Kalman Filter, Ensemble Kalman Filter (EnKF), 3D Variational (3DVar), and 4D Variational (4DVar) algorithms, allowing flexible algorithm selection based on application requirements. Comprehensive experiments conducted on the Lorenz 63 and a two-dimensional shallow water system demonstrate significantly enhanced performance over standalone model predictions without assimilation. The shallow water analysis validates data assimilation capabilities mapping between different physical quantity spaces in either full space or reduced order space. Overall, this innovative software package enables flexible integration of deep learning representations within data assimilation, conferring a versatile tool to tackle complex high dimensional dynamical systems across scientific domains.

📄 PDF Abstract BibTeX arXiv:2409.00244

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Learning

Similar Papers 제목 키워드 기반

PyPanda: a Python Package for Gene Regulatory Network Reconstruction

2016-07-12

PANDA (Passing Attributes between Networks for Data Assimilation) is a gene regulatory network inference method that uses message-passing to integrate multiple sources of 'omics data. PANDA was originally coded in C++. I…

hyppo: A Multivariate Hypothesis Testing Python Package

2019-07-03 · Sambit Panda, Satish Palaniappan, Junhao Xiong, Eric W. Bridgeford 외

We introduce hyppo, a unified library for performing multivariate hypothesis testing, including independence, two-sample, and k-sample testing. While many multivariate independence tests have R packages available, the in…

Two-sample testing

DADApy: Distance-based Analysis of DAta-manifolds in Python

2022-05-04 · Aldo Glielmo, Iuri Macocco, Diego Doimo, Matteo Carli 외

DADApy is a python software package for analysing and characterising high-dimensional data manifolds. It provides methods for estimating the intrinsic dimension and the probability density, for performing density-based c…

Clustering

LCE: An Augmented Combination of Bagging and Boosting in Python

2023-08-14 · Kevin Fauvel, Élisa Fromont, Véronique Masson, Philippe Faverdin 외

lcensemble is a high-performing, scalable and user-friendly Python package for the general tasks of classification and regression. The package implements Local Cascade Ensemble (LCE), a machine learning method that furth…

Model Selectionregression

PEPit: computer-assisted worst-case analyses of first-order optimization methods in Python

2022-01-11 · Baptiste Goujaud, Céline Moucer, François Glineur, Julien Hendrickx 외

PEPit is a Python package aiming at simplifying the access to worst-case analyses of a large family of first-order optimization methods possibly involving gradient, projection, proximal, or linear optimization oracles, a…