Dual Ensemble Kalman Filter for Stochastic Optimal Control
In this paper, stochastic optimal control problems in continuous time and space are considered. In recent years, such problems have received renewed attention from the lens of reinforcement learning (RL) which is also one of our motivation. The main contribution is a simulation-based algorithm -- dual ensemble Kalman filter (EnKF) -- to numerically approximate the solution of these problems. The paper extends our previous work where the dual EnKF was applied in deterministic settings of the problem. The theoretical results and algorithms are illustrated with numerical experiments.
Code (0)
등록된 구현이 없습니다.
Tasks
reinforcement-learningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Ensemble Kalman-Bucy filtering for nonlinear model predictive control
We consider the problem of optimal control for partially observed dynamical systems. Despite its prevalence in practical applications, there are still very few algorithms available, which take uncertainties in the curren…
Model Predictive ControlState EstimationOn the optimality of Kalman Filter for Fault Detection
Kalman filter is widely used for residual generation in fault detection. It leads to optimality in fault detection using some performance indices and also leads to statistically sound residual evaluation and threshold se…
Fault DetectionInformative Neural Ensemble Kalman Learning
In stochastic systems, informative approaches select key measurement or decision variables that maximize information gain to enhance the efficacy of model-related inferences. Neural Learning also embodies stochastic dyna…
Optimal Sensing Precision in Ensemble and Unscented Kalman Filtering
We consider the problem of selecting an optimal set of sensor precisions to estimate the states of a non-linear dynamical system using an Ensemble Kalman filter and an Unscented Kalman filter, which uses random and deter…
Kalman Filter-based Heuristic Ensemble (KFHE): A new perspective on multi-class ensemble classification using Kalman filters
This paper introduces a new perspective on multi-class ensemble classification that considers training an ensemble as a state estimation problem. The new perspective considers the final ensemble classifier model as a sta…
ClassificationGeneral ClassificationState Estimation