paper-with-me

홈 › Papers

Optimal Learning for Sequential Decisions in Laboratory Experimentation

2020-04-11 · Kristopher Reyes, Warren B. Powell

The process of discovery in the physical, biological and medical sciences can be painstakingly slow. Most experiments fail, and the time from initiation of research until a new advance reaches commercial production can span 20 years. This tutorial is aimed to provide experimental scientists with a foundation in the science of making decisions. Using numerical examples drawn from the experiences of the authors, the article describes the fundamental elements of any experimental learning problem. It emphasizes the important role of belief models, which include not only the best estimate of relationships provided by prior research, previous experiments and scientific expertise, but also the uncertainty in these relationships. We introduce the concept of a learning policy, and review the major categories of policies. We then introduce a policy, known as the knowledge gradient, that maximizes the value of information from each experiment. We bring out the importance of reducing uncertainty, and illustrate this process for different belief models.

📄 PDF Abstract BibTeX arXiv:2004.05417

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Towards Futuristic Autonomous Experimentation--A Surprise-Reacting Sequential Experiment Policy

2021-12-01 · Imtiaz Ahmed, Satish Bukkapatnam, Bhaskar Botcha, Yu Ding

An autonomous experimentation platform in manufacturing is supposedly capable of conducting a sequential search for finding suitable manufacturing conditions by itself or even for discovering new materials with minimal h…

Bayesian Optimization

Modernizing HEBO: a robust Bayesian optimization baseline for practical heteroskedastic and non-stationary problems

2026-07-12 · L. A. Zhukov, E. V. Shaburova, D. V. Antonets arxiv

Bayesian optimization is increasingly used to guide data-efficient experimentation in chemistry, materials science, and related laboratory settings, but its practical performance depends strongly on how well surrogate-mo…

Hyperparameter Optimization

Practical Policy Optimization with Personalized Experimentation

2023-03-30 · Mia Garrard, Hanson Wang, Ben Letham, Shaun Singh 외

Many organizations measure treatment effects via an experimentation platform to evaluate the casual effect of product variations prior to full-scale deployment. However, standard experimentation platforms do not perform …

Collaborative and Federated Black-box Optimization: A Bayesian Optimization Perspective

2024-11-12 · Raed Al Kontar

We focus on collaborative and federated black-box optimization (BBOpt), where agents optimize their heterogeneous black-box functions through collaborative sequential experimentation. From a Bayesian optimization perspec…

Bayesian OptimizationDecision MakingDescriptiveFederated Learning+1

Parallelizing Contextual Bandits

2021-05-21 · Jeffrey Chan, Aldo Pacchiano, Nilesh Tripuraneni, Yun S. Song 외

Standard approaches to decision-making under uncertainty focus on sequential exploration of the space of decisions. However, \textit{simultaneously} proposing a batch of decisions, which leverages available resources for…

Decision MakingDecision Making Under UncertaintyDiversityMulti-Armed Bandits