paper-with-me

홈 › Papers

Nonlinear Kalman Filtering based on Self-Attention Mechanism and Lattice Trajectory Piecewise Linear Approximation

2024-04-05 · JiaMing Wang, Xinyu Geng, Jun Xu

The traditional Kalman filter (KF) is widely applied in control systems, but it relies heavily on the accuracy of the system model and noise parameters, leading to potential performance degradation when facing inaccuracies. To address this issue, introducing neural networks into the KF framework offers a data-driven solution to compensate for these inaccuracies, improving the filter's performance while maintaining interpretability. Nevertheless, existing studies mostly employ recurrent neural network (RNN), which fails to fully capture the dependencies among state sequences and lead to an unstable training process. In this paper, we propose a novel Kalman filtering algorithm named the attention Kalman filter (AtKF), which incorporates a self-attention network to capture the dependencies among state sequences. To address the instability in the recursive training process, a parallel pre-training strategy is devised. Specifically, this strategy involves piecewise linearizing the system via lattice trajectory piecewise linear (LTPWL) expression, and generating pre-training data through a batch estimation algorithm, which exploits the self-attention mechanism's parallel processing ability. Experimental results on a two-dimensional nonlinear system demonstrate that AtKF outperforms other filters under noise disturbances and model mismatches.

📄 PDF Abstract BibTeX arXiv:2404.03915

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Nonlinear Kalman Filtering with Divergence Minimization

2017-05-01 · San Gultekin, John Paisley

We consider the nonlinear Kalman filtering problem using Kullback-Leibler (KL) and $\alpha$-divergence measures as optimization criteria. Unlike linear Kalman filters, nonlinear Kalman filters do not have closed form Gau…

Can a Transformer Represent a Kalman Filter?

2023-12-12 · Gautam Goel, Peter Bartlett

Transformers are a class of autoregressive deep learning architectures which have recently achieved state-of-the-art performance in various vision, language, and robotics tasks. We revisit the problem of Kalman Filtering…

Weighted Flow Matching and Physics-Informed Nonlinear Filtering for Parameter Estimation in Digital Twins

2026-05-16 · Yasar Yanik, Himadri Basu, Ricardo G. Sanfelice, Daniele Venturi arxiv

Digital twins (DTs) rely on continuous synchronization between physical systems and their virtual counterparts through online parameter estimation under uncertainty. In many practical settings, however, this task is chal…

NeuralKalman: A Learnable Kalman Filter for Acoustic Echo Cancellation

2023-01-29 · Yixuan Zhang, Meng Yu, Hao Zhang, Dong Yu 외

The robustness of the Kalman filter to double talk and its rapid convergence make it a popular approach for addressing acoustic echo cancellation (AEC) challenges. However, the inability to model nonlinearity and the nee…

Acoustic echo cancellation

Conditional Normalizing Flows for Forward and Backward Joint State and Parameter Estimation

2026-01-11 · Luke S. Lagunowich, Guoxiang Grayson Tong, Daniele E. Schiavazzi arxiv

Traditional filtering algorithms for state estimation -- such as classical Kalman filtering, unscented Kalman filtering, and particle filters -- show performance degradation when applied to nonlinear systems whose uncert…

Autonomous Driving