Transductive Active Learning with Application to Safe Bayesian Optimization
Safe Bayesian optimization (Safe BO) is the task of learning an optimal policy within an unknown environment, while ensuring that safety constraints are not violated. We analyze Safe BO under the lens of a generalization of active learning with concrete prediction targets where sampling is restricted to an accessible region of the domain, while prediction targets may lie outside this region. We study a family of policies that sample adaptively to minimize uncertainty about prediction targets. We are the first to show, under general regularity assumptions, that such policies converge uniformly to the smallest possible uncertainty obtainable from the accessible data. Leveraging this result, we apply our framework to Safe BO and demonstrate that our policies improve substantially upon the state-of-the-art.
Code (1)
Tasks
Active LearningBayesian OptimizationPredictionReinforcement Learning (RL)Safe ExplorationSafe Reinforcement LearningTransductive LearningSimilar Papers 제목 키워드 기반
Transductive Active Learning: Theory and Applications
We study a generalization of classical active learning to real-world settings with concrete prediction targets where sampling is restricted to an accessible region of the domain, while prediction targets may lie outside …
Active LearningBayesian OptimizationLearning TheoryPrediction+1Information-Theoretic Generalization Bounds for Transductive Learning and its Applications
In this paper, we establish generalization bounds for transductive learning algorithms in the context of information theory and PAC-Bayes, covering both the random sampling and the random splitting setting. First, we sho…
Generalization BoundsGraph LearningInductive LearningTransductive LearningSafe Exploration for Interactive Machine Learning
In Interactive Machine Learning (IML), we iteratively make decisions and obtain noisy observations of an unknown function. While IML methods, e.g., Bayesian optimization and active learning, have been successful in appli…
Active LearningBayesian OptimizationBIG-bench Machine LearningSafe ExplorationTransductive Rademacher Complexity and its Applications
We develop a technique for deriving data-dependent error bounds for transductive learning algorithms based on transductive Rademacher complexity. Our technique is based on a novel general error bound for transduction in …
Transductive LearningConstrained Multi-objective Bayesian Optimization through Optimistic Constraints Estimation
Multi-objective Bayesian optimization has been widely adopted in scientific experiment design, including drug discovery and hyperparameter optimization. In practice, regulatory or safety concerns often impose additional …
Active LearningBayesian OptimizationDrug DiscoveryHyperparameter Optimization