Primal-Dual Contextual Bayesian Optimization for Control System Online Optimization with Time-Average Constraints
This paper studies the problem of online performance optimization of constrained closed-loop control systems, where both the objective and the constraints are unknown black-box functions affected by exogenous time-varying contextual disturbances. A primal-dual contextual Bayesian optimization algorithm is proposed that achieves sublinear cumulative regret with respect to the dynamic optimal solution under certain regularity conditions. Furthermore, the algorithm achieves zero time-average constraint violation, ensuring that the average value of the constraint function satisfies the desired constraint. The method is applied to both sampled instances from Gaussian processes and a continuous stirred tank reactor parameter tuning problem; simulation results show that the method simultaneously provides close-to-optimal performance and maintains constraint feasibility on average. This contrasts current state-of-the-art methods, which either suffer from large cumulative regret or severe constraint violations for the case studies presented.
Code (1)
Tasks
Bayesian OptimizationGaussian ProcessesSimilar Papers 제목 키워드 기반
Data-driven adaptive building thermal controller tuning with constraints: A primal-dual contextual Bayesian optimization approach
We study the problem of tuning the parameters of a room temperature controller to minimize its energy consumption, subject to the constraint that the daily cumulative thermal discomfort of the occupants is below a given …
Bayesian OptimizationPrimal-dual algorithm for contextual stochastic combinatorial optimization
This paper introduces a novel approach to contextual stochastic optimization, integrating operations research and machine learning to address decision-making under uncertainty. Traditional methods often fail to leverage …
Combinatorial OptimizationDecision Making Under UncertaintyImitation LearningStochastic OptimizationFeaturized Occupation Measures for Structured Global Search in Numerical Optimal Control
Numerical optimal control has long been split between globally structured but dimensionally intractable Hamilton--Jacobi--Bellman (HJB) methods and scalable but local trajectory optimization. We introduce Featurized Occu…
Large Scale Model Predictive Control with Neural Networks and Primal Active Sets
This work presents an explicit-implicit procedure to compute a model predictive control (MPC) law with guarantees on recursive feasibility and asymptotic stability. The approach combines an offline-trained fully-connecte…
Model Predictive ControlController Adaptation via Learning Solutions of Contextual Bayesian Optimization
In this work, we propose a framework for adapting the controller's parameters based on learning optimal solutions from contextual black-box optimization problems. We consider a class of control design problems for dynami…
Bayesian OptimizationGaussian ProcessesModel Predictive Control