Targeted Active Learning for Bayesian Decision-Making
Active learning is usually applied to acquire labels of informative data points in supervised learning, to maximize accuracy in a sample-efficient way. However, maximizing the accuracy is not the end goal when the results are used for decision-making, for example in personalized medicine or economics. We argue that when acquiring samples sequentially, separating learning and decision-making is sub-optimal, and we introduce an active learning strategy which takes the down-the-line decision problem into account. Specifically, we introduce a novel active learning criterion which maximizes the expected information gain on the posterior distribution of the optimal decision. We compare our targeted active learning strategy to existing alternatives on both simulated and real data, and show improved performance in decision-making accuracy.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningDecision MakingSimilar Papers 제목 키워드 기반
Decisive: Guiding User Decisions with Optimal Preference Elicitation from Unstructured Documents
Decision-making is a cognitively intensive task that requires synthesizing relevant information from multiple unstructured sources, weighing competing factors, and incorporating subjective user preferences. Existing meth…
Instantiating Bayesian CVaR lower bounds in Interactive Decision Making Problems
Recent work established a generalized-Fano framework for lower bounding prior-predictive (Bayesian) CVaR in interactive statistical decision making. In this paper, we show how to instantiate that framework in concrete in…
Decision MakingFast, Optimal, and Targeted Predictions using Parametrized Decision Analysis
Prediction is critical for decision-making under uncertainty and lends validity to statistical inference. With targeted prediction, the goal is to optimize predictions for specific decision tasks of interest, which we re…
Decision MakingDecision Making Under UncertaintyNutritionPrediction+1Bayesian implementation of Targeted Maximum Likelihood Estimation for uncertainty quantification in causal effect estimation
Robust decision making involves making decisions in the presence of uncertainty and is often used in critical domains such as healthcare, supply chains, and finance. Causality plays a crucial role in decision-making as i…
Decision MakingDecision making in dynamic and interactive environments based on cognitive hierarchy theory, Bayesian inference, and predictive control
In this paper, we describe an integrated framework for autonomous decision making in a dynamic and interactive environment. We model the interactions between the ego agent and its operating environment as a two-player dy…
Autonomous DrivingBayesian InferenceDecision Making