Bayesian Optimisation for Robust Model Predictive Control under Model Parameter Uncertainty
We propose an adaptive optimisation approach for tuning stochastic model predictive control (MPC) hyper-parameters while jointly estimating probability distributions of the transition model parameters based on performance rewards. In particular, we develop a Bayesian optimisation (BO) algorithm with a heteroscedastic noise model to deal with varying noise across the MPC hyper-parameter and dynamics model parameter spaces. Typical homoscedastic noise models are unrealistic for tuning MPC since stochastic controllers are inherently noisy, and the level of noise is affected by their hyper-parameter settings. We evaluate the proposed optimisation algorithm in simulated control and robotics tasks where we jointly infer control and dynamics parameters. Experimental results demonstrate that our approach leads to higher cumulative rewards and more stable controllers.
Code (0)
등록된 구현이 없습니다.
Tasks
Bayesian OptimisationmodelModel Predictive ControlSimilar Papers 제목 키워드 기반
Heteroscedastic Bayesian Optimisation for Stochastic Model Predictive Control
Model predictive control (MPC) has been successful in applications involving the control of complex physical systems. This class of controllers leverages the information provided by an approximate model of the system's d…
Bayesian Optimisationcontinuous-controlContinuous Controlmodel+1Adaptive Model Predictive Control by Learning Classifiers
Stochastic model predictive control has been a successful and robust control framework for many robotics tasks where the system dynamics model is slightly inaccurate or in the presence of environment disturbances. Despit…
Bayesian OptimisationDensity Ratio EstimationmodelModel Predictive ControlDecision Making under the Exponential Family: Distributionally Robust Optimisation with Bayesian Ambiguity Sets
Decision making under uncertainty is challenging as the data-generating process (DGP) is often unknown. Bayesian inference proceeds by estimating the DGP through posterior beliefs on the model's parameters. However, mini…
Bayesian InferenceDecision MakingDecision Making Under UncertaintyDeep Learning: A Bayesian Perspective
Deep learning is a form of machine learning for nonlinear high dimensional pattern matching and prediction. By taking a Bayesian probabilistic perspective, we provide a number of insights into more efficient algorithms f…
Deep LearningregressionVariable SelectionOn the development of a practical Bayesian optimisation algorithm for expensive experiments and simulations with changing environmental conditions
Experiments in engineering are typically conducted in controlled environments where parameters can be set to any desired value. This assumes that the same applies in a real-world setting -- an assumption that is often in…
Bayesian Optimisation