paper-with-me

Papers

Expert-guided Bayesian Optimisation for Human-in-the-loop Experimental Design of Known Systems

2023-12-05 · Tom Savage, Ehecatl Antonio del Rio Chanona

Domain experts often possess valuable physical insights that are overlooked in fully automated decision-making processes such as Bayesian optimisation. In this article we apply high-throughput (batch) Bayesian optimisation alongside anthropological decision theory to enable domain experts to influence the selection of optimal experiments. Our methodology exploits the hypothesis that humans are better at making discrete choices than continuous ones and enables experts to influence critical early decisions. At each iteration we solve an augmented multi-objective optimisation problem across a number of alternate solutions, maximising both the sum of their utility function values and the determinant of their covariance matrix, equivalent to their total variability. By taking the solution at the knee point of the Pareto front, we return a set of alternate solutions at each iteration that have both high utility values and are reasonably distinct, from which the expert selects one for evaluation. We demonstrate that even in the case of an uninformed practitioner, our algorithm recovers the regret of standard Bayesian optimisation.

📄 PDF Abstract BibTeX arXiv:2312.02852

Code (1)

trsav/hitl-bo 공식 구현 jax

Tasks

Bayesian OptimisationDecision MakingExperimental Design

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Principled Bayesian Optimisation in Collaboration with Human Experts

2024-10-14 · Wenjie Xu, Masaki Adachi, Colin N. Jones, Michael A. Osborne

Bayesian optimisation for real-world problems is often performed interactively with human experts, and integrating their domain knowledge is key to accelerate the optimisation process. We consider a setup where experts p…

Bayesian Optimisation

Automated Machine Learning on Big Data using Stochastic Algorithm Tuning

2014-07-30 · Thomas Nickson, Michael A. Osborne, Steven Reece, Stephen J. Roberts

We introduce a means of automating machine learning (ML) for big data tasks, by performing scalable stochastic Bayesian optimisation of ML algorithm parameters and hyper-parameters. More often than not, the critical tuni…

Bayesian OptimisationBenchmarkingBIG-bench Machine LearningTime Series+2

Bayesian Deep Learning for Interactive Community Question Answering

2022-01-16 · ACL ARR January 2022 1 · Anonymous

Human-in-the-loop interactive learning has been shown to be effective for best solution selection tasks. Bayesian Optimisation (BO) reduces the amount of user interaction required but has so far relied on shallow models …

Bayesian OptimisationCommunity Question AnsweringDeep LearningQuestion Answering

Inducing Point Allocation for Sparse Gaussian Processes in High-Throughput Bayesian Optimisation

2023-01-24 · Henry B. Moss, Sebastian W. Ober, Victor Picheny

Sparse Gaussian Processes are a key component of high-throughput Bayesian Optimisation (BO) loops; however, we show that existing methods for allocating their inducing points severely hamper optimisation performance. By …

Bayesian OptimisationDecision MakingDiversityGaussian Processes+2

Incorporating Expert Prior in Bayesian Optimisation via Space Warping

2020-03-27 · Anil Ramachandran, Sunil Gupta, Santu Rana, Cheng Li 외

Bayesian optimisation is a well-known sample-efficient method for the optimisation of expensive black-box functions. However when dealing with big search spaces the algorithm goes through several low function value regio…

Bayesian Optimisation