paper-with-me

Papers

Human-Algorithm Collaborative Bayesian Optimization for Engineering Systems

2024-04-16 · Tom Savage, Ehecatl Antonio del Rio Chanona

Bayesian optimization has been successfully applied throughout Chemical Engineering for the optimization of functions that are expensive-to-evaluate, or where gradients are not easily obtainable. However, domain experts often possess valuable physical insights that are overlooked in fully automated decision-making approaches, necessitating the inclusion of human input. In this article we re-introduce the human back into the data-driven decision making loop by outlining an approach for collaborative Bayesian optimization. Our methodology exploits the hypothesis that humans are more efficient at making discrete choices rather than continuous ones and enables experts to influence critical early decisions. We apply high-throughput (batch) Bayesian optimization alongside discrete decision theory to enable domain experts to influence the selection of experiments. At every iteration we apply a multi-objective approach that results in a set of alternate solutions that have both high utility and are reasonably distinct. The expert then selects the desired solution for evaluation from this set, allowing for the inclusion of expert knowledge and improving accountability, whilst maintaining the advantages of Bayesian optimization. We demonstrate our approach across a number of applied and numerical case studies including bioprocess optimization and reactor geometry design, demonstrating that even in the case of an uninformed practitioner our algorithm recovers the regret of standard Bayesian optimization. Through the inclusion of continuous expert opinion, our approach enables faster convergence, and improved accountability for Bayesian optimization in engineering systems.

📄 PDF Abstract BibTeX arXiv:2404.10949

Code (1)

optimal-pse-lab/humbo 공식 구현 jax

Tasks

Bayesian OptimizationDecision Making

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Looping in the Human Collaborative and Explainable Bayesian Optimization

2023-10-26 · Masaki Adachi, Brady Planden, David A. Howey, Michael A. Osborne 외

Like many optimizers, Bayesian optimization often falls short of gaining user trust due to opacity. While attempts have been made to develop human-centric optimizers, they typically assume user knowledge is well-specifie…

Bayesian Optimization

ARCO-BO: Adaptive Resource-aware COllaborative Bayesian Optimization for Heterogeneous Multi-Agent Design

2025-10-18 · Zihan Wang, Yi-Ping Chen, Tuba Dolar, Wei Chen arxiv

Modern scientific and engineering design increasingly involves distributed optimization, where agents such as laboratories, simulations, or industrial partners pursue related goals under differing conditions. These agent…

Distributed Optimization

CoFEH: LLM-driven Feature Engineering Empowered by Collaborative Bayesian Hyperparameter Optimization

2026-02-10 · Beicheng Xu, Keyao Ding, Wei Liu, Yupeng Lu 외 arxiv

Feature Engineering (FE) is pivotal in automated machine learning (AutoML) but remains a bottleneck for traditional methods, which operate within rigid search spaces and lack domain awareness. While Large Language Models…

Hyperparameter OptimizationFeature Engineering

ATM: A distributed, collaborative, scalable system for automated machine learning

2017-12-11 · 2017 IEEE International Conference on Big Data (Big Data) 2017 12 · Thomas Swearingen, Will Drevo, Bennett Cyphers, Alfredo Cuesta-Infante 외

In this paper, we present Auto-Tuned Models, or ATM, a distributed, collaborative, scalable system for automated machine learning. Users of ATM can simply upload a dataset, choose a subset of modeling methods, and choose…

AutoMLBIG-bench Machine LearningFeature EngineeringHyperparameter Optimization+1

Quantum Computing and AI: Perspectives on Advanced Automation in Science and Engineering

2025-05-15 · Tadashi Kadowaki

Recent advances in artificial intelligence (AI) and quantum computing are accelerating automation in scientific and engineering processes, fundamentally reshaping research methodologies. This perspective highlights paral…

Combinatorial Optimization