Optimal Learning for Sequential Decisions in Laboratory Experimentation
The process of discovery in the physical, biological and medical sciences can be painstakingly slow. Most experiments fail, and the time from initiation of research until a new advance reaches commercial production can span 20 years. This tutorial is aimed to provide experimental scientists with a foundation in the science of making decisions. Using numerical examples drawn from the experiences of the authors, the article describes the fundamental elements of any experimental learning problem. It emphasizes the important role of belief models, which include not only the best estimate of relationships provided by prior research, previous experiments and scientific expertise, but also the uncertainty in these relationships. We introduce the concept of a learning policy, and review the major categories of policies. We then introduce a policy, known as the knowledge gradient, that maximizes the value of information from each experiment. We bring out the importance of reducing uncertainty, and illustrate this process for different belief models.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Towards Futuristic Autonomous Experimentation--A Surprise-Reacting Sequential Experiment Policy
An autonomous experimentation platform in manufacturing is supposedly capable of conducting a sequential search for finding suitable manufacturing conditions by itself or even for discovering new materials with minimal h…
Bayesian OptimizationModernizing HEBO: a robust Bayesian optimization baseline for practical heteroskedastic and non-stationary problems
Bayesian optimization is increasingly used to guide data-efficient experimentation in chemistry, materials science, and related laboratory settings, but its practical performance depends strongly on how well surrogate-mo…
Hyperparameter OptimizationPractical Policy Optimization with Personalized Experimentation
Many organizations measure treatment effects via an experimentation platform to evaluate the casual effect of product variations prior to full-scale deployment. However, standard experimentation platforms do not perform …
Collaborative and Federated Black-box Optimization: A Bayesian Optimization Perspective
We focus on collaborative and federated black-box optimization (BBOpt), where agents optimize their heterogeneous black-box functions through collaborative sequential experimentation. From a Bayesian optimization perspec…
Bayesian OptimizationDecision MakingDescriptiveFederated Learning+1Parallelizing Contextual Bandits
Standard approaches to decision-making under uncertainty focus on sequential exploration of the space of decisions. However, \textit{simultaneously} proposing a batch of decisions, which leverages available resources for…
Decision MakingDecision Making Under UncertaintyDiversityMulti-Armed Bandits