paper-with-me

홈 › Papers

Observation Error Covariance Specification in Dynamical Systems for Data assimilation using Recurrent Neural Networks

2021-11-11 · Sibo Cheng, Mingming Qiu

Data assimilation techniques are widely used to predict complex dynamical systems with uncertainties, based on time-series observation data. Error covariance matrices modelling is an important element in data assimilation algorithms which can considerably impact the forecasting accuracy. The estimation of these covariances, which usually relies on empirical assumptions and physical constraints, is often imprecise and computationally expensive especially for systems of large dimension. In this work, we propose a data-driven approach based on long short term memory (LSTM) recurrent neural networks (RNN) to improve both the accuracy and the efficiency of observation covariance specification in data assimilation for dynamical systems. Learning the covariance matrix from observed/simulated time-series data, the proposed approach does not require any knowledge or assumption about prior error distribution, unlike classical posterior tuning methods. We have compared the novel approach with two state-of-the-art covariance tuning algorithms, namely DI01 and D05, first in a Lorenz dynamical system and then in a 2D shallow water twin experiments framework with different covariance parameterization using ensemble assimilation. This novel method shows significant advantages in observation covariance specification, assimilation accuracy and computational efficiency.

📄 PDF Abstract BibTeX arXiv:2111.06447

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyTime SeriesTime Series Analysis

Similar Papers 제목 키워드 기반

Deep learning-enhanced ensemble-based data assimilation for high-dimensional nonlinear dynamical systems

2022-06-09 · Ashesh Chattopadhyay, Ebrahim Nabizadeh, Eviatar Bach, Pedram Hassanzadeh

Data assimilation (DA) is a key component of many forecasting models in science and engineering. DA allows one to estimate better initial conditions using an imperfect dynamical model of the system and noisy/sparse obser…

Machine learning with data assimilation and uncertainty quantification for dynamical systems: a review

2023-03-18 · Sibo Cheng, Cesar Quilodran-Casas, Said Ouala, Alban Farchi 외

Data Assimilation (DA) and Uncertainty quantification (UQ) are extensively used in analysing and reducing error propagation in high-dimensional spatial-temporal dynamics. Typical applications span from computational flui…

Uncertainty Quantification

Efficient deep data assimilation with sparse observations and time-varying sensors

2023-10-24 · Sibo Cheng, Che Liu, Yike Guo, Rossella Arcucci

Variational Data Assimilation (DA) has been broadly used in engineering problems for field reconstruction and prediction by performing a weighted combination of multiple sources of noisy data. In recent years, the integr…

Estimation under Model Misspecification with Fake Features

2022-03-07 · Martin Hellkvist, Ayça Özçelikkale, Anders Ahlén

We consider estimation under model misspecification where there is a model mismatch between the underlying system, which generates the data, and the model used during estimation. We propose a model misspecification frame…

model

Improved rates for prediction and identification for partially observed linear dynamical systems

2021-05-21 · NeurIPS 2021 12 · Holden Lee

Identification of a linear time-invariant dynamical system from partial observations is a fundamental problem in control theory. Particularly challenging are systems exhibiting long-term memory. A natural question is ho…