paper-with-me

홈 › Papers

Robust Online Model Adaptation by Extended Kalman Filter with Exponential Moving Average and Dynamic Multi-Epoch Strategy

2019-12-04 · L4DC 2020 6 · Abulikemu Abuduweili, Changliu Liu

High fidelity behavior prediction of intelligent agents is critical in many applications. However, the prediction model trained on the training set may not generalize to the testing set due to domain shift and time variance. The challenge motivates the adoption of online adaptation algorithms to update prediction models in real-time to improve the prediction performance. Inspired by Extended Kalman Filter (EKF), this paper introduces a series of online adaptation methods, which are applicable to neural network-based models. A base adaptation algorithm Modified EKF with forgetting factor (MEKF$_\lambda$) is introduced first, followed by exponential moving average filtering techniques. Then this paper introduces a dynamic multi-epoch update strategy to effectively utilize samples received in real time. With all these extensions, we propose a robust online adaptation algorithm: MEKF with Exponential Moving Average and Dynamic Multi-Epoch strategy (MEKF$_{\text{EMA-DME}}$). The proposed algorithm outperforms existing methods as demonstrated in experiments. The source code is open-sourced in the following link https://github.com/intelligent-control-lab/MEKF_MAME.

📄 PDF Abstract BibTeX arXiv:1912.01790

Code (1)

intelligent-control-lab/MEKF_MAME 공식 구현 pytorch

Tasks

Prediction

Similar Papers 제목 키워드 기반

The decoupled extended Kalman filter for dynamic exponential-family factorization models

2018-06-26 · Carlos Alberto Gomez-Uribe, Brian Karrer

Motivated by the needs of online large-scale recommender systems, we specialize the decoupled extended Kalman filter (DEKF) to factorization models, including factorization machines, matrix and tensor factorization, and …

Recommendation Systems

Low-rank extended Kalman filtering for online learning of neural networks from streaming data

2023-05-31 · Peter G. Chang, Gerardo Durán-Martín, Alexander Y Shestopaloff, Matt Jones 외

We propose an efficient online approximate Bayesian inference algorithm for estimating the parameters of a nonlinear function from a potentially non-stationary data stream. The method is based on the extended Kalman filt…

Bayesian InferenceVariational Inference

Stability of the Decoupled Extended Kalman Filter Learning Algorithm in LSTM-Based Online Learning

2019-11-25 · Nuri Mert Vural, Fatih Ilhan, Suleyman S. Kozat

We investigate the convergence and stability properties of the decoupled extended Kalman filter learning algorithm (DEKF) within the long-short term memory network (LSTM) based online learning framework. For this purpose…

Bayesian Inference via Approximation of Log-likelihood for Priors in Exponential Family

2015-10-05 · Tohid Ardeshiri, Umut Orguner, Fredrik Gustafsson

In this paper, a Bayesian inference technique based on Taylor series approximation of the logarithm of the likelihood function is presented. The proposed approximation is devised for the case, where the prior distributio…

Bayesian Inference

The Extended Kalman Filter is a Natural Gradient Descent in Trajectory Space

2019-01-03 · Yann Ollivier

The extended Kalman filter is perhaps the most standard tool to estimate in real time the state of a dynamical system from noisy measurements of some function of the system, with extensive practical applications (such as…