Reinforcement Learning Approach to Estimation in Linear Systems

2022-05-06 · Minyue Fu

This paper addresses two important estimation problems for linear systems, namely system identification and model-free state estimation. Our focus is on ARMAX models with unknown parameters. We first provide a reinforcement learning algorithm for system identification with guaranteed consistency. This algorithm is then used to provide a novel solution to model-free state estimation. These results are then applied to solving the model-free LQG control problem in the reinforcement learning setting.

📄 PDF Abstract BibTeX arXiv:2205.03504

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)State Estimation

Reinforcement Learning State Estimation for High-Dimensional Nonlinear Systems

2021-09-29 · Saviz Mowlavi, Mouhacine Benosman, Saleh Nabi

In high-dimensional nonlinear systems such as fluid flows, the design of state estimators such as Kalman filters relies on a reduced-order model (ROM) of the dynamics. However, ROMs are prone to large errors, which negat…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)State Estimation+1

Boosting Verification of Deep Reinforcement Learning via Piece-Wise Linear Decision Neural Networks

2023-09-21 · NeurIPS 2023 11

Formally verifying deep reinforcement learning (DRL) systems suffers from both inaccurate verification results and limited scalability. The major obstacle lies in the large overestimation introduced inherently during tra…

Koopman-based Deep Learning for Nonlinear System Estimation

2024-05-01 · Zexin Sun, Mingyu Chen, John Baillieul

Nonlinear differential equations are encountered as models of fluid flow, spiking neurons, and many other systems of interest in the real world. Common features of these systems are that their behaviors are difficult to …

Deep Learning Transfer Learning

Lyapunov-Based Reinforcement Learning State Estimator

2020-10-26 · Liang Hu, ChengWei Wu, Wei Pan

In this paper, we consider the state estimation problem for nonlinear stochastic discrete-time systems. We combine Lyapunov's method in control theory and deep reinforcement learning to design the state estimator. We the…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Active Learning for Nonlinear System Identification with Guarantees

2020-06-18 · Horia Mania, Michael. I. Jordan, Benjamin Recht

While the identification of nonlinear dynamical systems is a fundamental building block of model-based reinforcement learning and feedback control, its sample complexity is only understood for systems that either have di…

Active Learning Model-based Reinforcement Learning Trajectory Planning