Near Optimal Bayesian Active Learning for Decision Making
How should we gather information to make effective decisions? We address Bayesian active learning and experimental design problems, where we sequentially select tests to reduce uncertainty about a set of hypotheses. Instead of minimizing uncertainty per se, we consider a set of overlapping decision regions of these hypotheses. Our goal is to drive uncertainty into a single decision region as quickly as possible. We identify necessary and sufficient conditions for correctly identifying a decision region that contains all hypotheses consistent with observations. We develop a novel Hyperedge Cutting (HEC) algorithm for this problem, and prove that is competitive with the intractable optimal policy. Our efficient implementation of the algorithm relies on computing subsets of the complete homogeneous symmetric polynomials. Finally, we demonstrate its effectiveness on two practical applications: approximate comparison-based learning and active localization using a robot manipulator.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningDecision MakingExperimental DesignSimilar Papers 제목 키워드 기반
Targeted Active Learning for Bayesian Decision-Making
Active learning is usually applied to acquire labels of informative data points in supervised learning, to maximize accuracy in a sample-efficient way. However, maximizing the accuracy is not the end goal when the result…
Active LearningDecision MakingThe Statistical Complexity of Interactive Decision Making
A fundamental challenge in interactive learning and decision making, ranging from bandit problems to reinforcement learning, is to provide sample-efficient, adaptive learning algorithms that achieve near-optimal regret. …
Decision Makingreinforcement-learningReinforcement Learning (RL)Decision making in dynamic and interactive environments based on cognitive hierarchy theory, Bayesian inference, and predictive control
In this paper, we describe an integrated framework for autonomous decision making in a dynamic and interactive environment. We model the interactions between the ego agent and its operating environment as a two-player dy…
Autonomous DrivingBayesian InferenceDecision MakingEvolution of Information in Interactive Decision Making: A Case Study for Multi-Armed Bandits
We study the evolution of information in interactive decision making through the lens of a stochastic multi-armed bandit problem. Focusing on a fundamental example where a unique optimal arm outperforms the rest by a fix…
Decision MakingMulti-Armed BanditsRobust Bayesian Decision Making under Adversarial Uncertainty
Scientific experiments are often designed to maximize information gain, yet in many applications the primary objective is to support reliable downstream decision-making. Existing decision-aware experimental design and ac…
Active LearningDecision Making