Learning an Optimization Algorithm through Human Design Iterations

2016-08-24 · Thurston Sexton, Max Yi Ren

Solving optimal design problems through crowdsourcing faces a dilemma: On one hand, human beings have been shown to be more effective than algorithms at searching for good solutions of certain real-world problems with high-dimensional or discrete solution spaces; on the other hand, the cost of setting up crowdsourcing environments, the uncertainty in the crowd's domain-specific competence, and the lack of commitment of the crowd, all contribute to the lack of real-world application of design crowdsourcing. We are thus motivated to investigate a solution-searching mechanism where an optimization algorithm is tuned based on human demonstrations on solution searching, so that the search can be continued after human participants abandon the problem. To do so, we model the iterative search process as a Bayesian Optimization (BO) algorithm, and propose an inverse BO (IBO) algorithm to find the maximum likelihood estimators of the BO parameters based on human solutions. We show through a vehicle design and control problem that the search performance of BO can be improved by recovering its parameters based on an effective human search. Thus, IBO has the potential to improve the success rate of design crowdsourcing activities, by requiring only good search strategies instead of good solutions from the crowd.

📄 PDF Abstract BibTeX arXiv:1608.06984

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian Optimization

Efficient Federated RLHF via Zeroth-Order Policy Optimization

2026-04-20 · Deyi Wang, Qining Zhang, Lei Ying arxiv

This paper considers reinforcement learning from human feedback in a federated learning setting with resource-constrained agents, such as edge devices. We propose an efficient federated RLHF algorithm, named Partitioned,…

Reinforcement Learning Federated Learning

Learning to Warm-Start Fixed-Point Optimization Algorithms

2023-09-14 · Rajiv Sambharya, Georgina Hall, Brandon Amos, Bartolomeo Stellato

We introduce a machine-learning framework to warm-start fixed-point optimization algorithms. Our architecture consists of a neural network mapping problem parameters to warm starts, followed by a predefined number of fix…

Generalization Bounds

Prompting in the Dark: Assessing Human Performance in Prompt Engineering for Data Labeling When Gold Labels Are Absent

2025-02-16 · Zeyu He, Saniya Naphade, Ting-Hao 'Kenneth' Huang

Millions of users prompt large language models (LLMs) for various tasks, but how good are people at prompt engineering? Do users actually get closer to their desired outcome over multiple iterations of their prompts? The…

Prompt Engineering

Optimization-Based GenQSGD for Federated Edge Learning

2021-10-25 · Yangchen Li, Ying Cui, Vincent Lau

Optimal algorithm design for federated learning (FL) remains an open problem. This paper explores the full potential of FL in practical edge computing systems where workers may have different computation and communicatio…

Edge-computing Federated Learning

Learning to Optimize

2016-06-06 · 2016 2016 6 · Ke Li, Jitendra Malik

Algorithm design is a laborious process and often requires many iterations of ideation and validation. In this paper, we explore automating algorithm design and present a method to learn an optimization algorithm, which …

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)