Stagewise Safe Bayesian Optimization with Gaussian Processes
Enforcing safety is a key aspect of many problems pertaining to sequential decision making under uncertainty, which require the decisions made at every step to be both informative of the optimal decision and also safe. For example, we value both efficacy and comfort in medical therapy, and efficiency and safety in robotic control. We consider this problem of optimizing an unknown utility function with absolute feedback or preference feedback subject to unknown safety constraints. We develop an efficient safe Bayesian optimization algorithm, StageOpt, that separates safe region expansion and utility function maximization into two distinct stages. Compared to existing approaches which interleave between expansion and optimization, we show that StageOpt is more efficient and naturally applicable to a broader class of problems. We provide theoretical guarantees for both the satisfaction of safety constraints as well as convergence to the optimal utility value. We evaluate StageOpt on both a variety of synthetic experiments, as well as in clinical practice. We demonstrate that StageOpt is more effective than existing safe optimization approaches, and is able to safely and effectively optimize spinal cord stimulation therapy in our clinical experiments.
Code (0)
등록된 구현이 없습니다.
Tasks
Bayesian OptimizationDecision MakingDecision Making Under UncertaintyGaussian ProcessesSequential Decision MakingSimilar Papers 제목 키워드 기반
Safe Bayesian optimization across noise models via scenario programming
Safe Bayesian optimization (BO) with Gaussian processes is an effective tool for tuning control policies in safety-critical real-world systems, specifically due to its sample efficiency and safety guarantees. However, mo…
Gaussian ProcessesSafe Bayesian Optimization for Complex Control Systems via Additive Gaussian Processes
Controller tuning and optimization have been among the most fundamental problems in robotics and mechatronic systems. The traditional methodology is usually model-based, but its performance heavily relies on an accurate …
Bayesian OptimizationGaussian ProcessesBayesian Optimization using Deep Gaussian Processes
Bayesian Optimization using Gaussian Processes is a popular approach to deal with the optimization of expensive black-box functions. However, because of the a priori on the stationarity of the covariance matrix of classi…
Bayesian OptimizationGaussian Processesglobal-optimizationSafe Real-Time Optimization using Multi-Fidelity Gaussian Processes
This paper proposes a new class of real-time optimization schemes to overcome system-model mismatch of uncertain processes. This work's novelty lies in integrating derivative-free optimization schemes and multi-fidelity …
Bayesian OptimizationGaussian ProcessesUncertainty QuantificationRegret Bounds for Safe Gaussian Process Bandit Optimization
Many applications require a learner to make sequential decisions given uncertainty regarding both the system's payoff function and safety constraints. In safety-critical systems, it is paramount that the learner's action…
Gaussian Processes