Sequential Learning from Noisy Data: Data-Assimilation Meets Echo-State Network
This paper explores the problem of training a recurrent neural network from noisy data. While neural network based dynamic predictors perform well with noise-free training data, prediction with noisy inputs during training phase poses a significant challenge. Here a sequential training algorithm is developed for an echo-state network (ESN) by incorporating noisy observations using an ensemble Kalman filter. The resultant Kalman-trained echo-state network (KalT-ESN) outperforms the traditionally trained ESN with least square algorithm while still being computationally cheap. The proposed method is demonstrated on noisy observations from three systems: two synthetic datasets from chaotic dynamical systems and a set of real-time traffic data.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Combining machine learning and data assimilation to forecast dynamical systems from noisy partial observations
We present a supervised learning method to learn the propagator map of a dynamical system from partial and noisy observations. In our computationally cheap and easy-to-implement framework a neural network consisting of r…
Supervised learning from noisy observations: Combining machine-learning techniques with data assimilation
Data-driven prediction and physics-agnostic machine-learning methods have attracted increased interest in recent years achieving forecast horizons going well beyond those to be expected for chaotic dynamical systems. In …
BIG-bench Machine LearningSURGE: Approximation and Training Free Particle Filter for Diffusion Surrogate
Data assimilation (DA) addresses the problem of sequentially estimating the state of a dynamical system from noisy and incomplete observations. In this work, we employ a diffusion model as a world model to simulate and p…
Diffusion Model-Based Data Assimilation for Real-World Energy Consumption Forecasting
Accurate estimation and forecasting of energy consumption are important for power-system operation, planning, and demand-side management. In practice, however, complete and timely measurements may not always be available…
Adjoint-Matching Neural Network Surrogates for Fast 4D-Var Data Assimilation
Data assimilation is the process of fusing information from imperfect computer simulations with noisy, sparse measurements of reality to obtain improved estimates of the state or parameters of a dynamical system of inter…
Weather Forecasting