Contextual Causal Bayesian Optimisation
Causal Bayesian optimisation (CaBO) combines causality with Bayesian optimisation (BO) and shows that there are situations where the optimal reward is not achievable if causal knowledge is ignored. While CaBO exploits causal relations to determine the set of controllable variables to intervene on, it does not exploit purely observational variables and marginalises them. We show that, in general, utilising a subset of observational variables as a context to choose the values of interventional variables leads to lower cumulative regrets. We propose a general framework of contextual causal Bayesian optimisation that efficiently searches through combinations of controlled and contextual variables, known as policy scopes, and identifies the one yielding the optimum. We highlight the difficulties arising from the application of the causal acquisition function currently used in CaBO to select the policy scope in contextual settings and propose a multi-armed bandits based selection mechanism. We analytically show that well-established methods, such as contextual BO (CoBO) or CaBO, are not able to achieve the optimum in some cases, and empirically show that the proposed method achieves sub-linear regret in various environments and under different configurations.
Code (0)
등록된 구현이 없습니다.
Tasks
Bayesian OptimisationMulti-Armed BanditsSimilar Papers 제목 키워드 기반
Graph Agnostic Causal Bayesian Optimisation
We study the problem of globally optimising a target variable of an unknown causal graph on which a sequence of soft or hard interventions can be performed. The problem of optimising the target variable associated with a…
Bayesian OptimisationBayesian OptimizationEfficient Real-world Testing of Causal Decision Making via Bayesian Experimental Design for Contextual Optimisation
The real-world testing of decisions made using causal machine learning models is an essential prerequisite for their successful application. We focus on evaluating and improving contextual treatment assignment decisions:…
Decision MakingExperimental DesignOptimal Observation-Intervention Trade-Off in Optimisation Problems with Causal Structure
We consider the problem of optimising an expensive-to-evaluate grey-box objective function, within a finite budget, where known side-information exists in the form of the causal structure between the design variables. St…
Bayesian OptimisationDeveloping Optimal Causal Cyber-Defence Agents via Cyber Security Simulation
In this paper we explore cyber security defence, through the unification of a novel cyber security simulator with models for (causal) decision-making through optimisation. Particular attention is paid to a recently publi…
Bayesian OptimisationDecision MakingOptimal experimental design via Bayesian optimization: active causal structure learning for Gaussian process networks
We study the problem of causal discovery through targeted interventions. Starting from few observational measurements, we follow a Bayesian active learning approach to perform those experiments which, in expectation with…
Active LearningBayesian OptimisationBayesian OptimizationCausal Discovery+1