paper-with-me

홈 › Papers

A General Stochastic Algorithmic Framework for Minimizing Expensive Black Box Objective Functions Based on Surrogate Models and Sensitivity Analysis

2014-10-23 · Yi-Lun Wang, Christine A. Shoemaker

We are focusing on bound constrained global optimization problems, whose objective functions are computationally expensive black-box functions and have multiple local minima. The recently popular Metric Stochastic Response Surface (MSRS) algorithm proposed by \cite{Regis2007SRBF} based on adaptive or sequential learning based on response surfaces is revisited and further extended for better performance in case of higher dimensional problems. Specifically, we propose a new way to generate the candidate points which the next function evaluation point is picked from according to the metric criteria, based on a new definition of distance, and prove the global convergence of the corresponding. Correspondingly, a more adaptive implementation of MSRS, named "SO-SA", is presented. "SO-SA" is is more likely to perturb those most sensitive coordinates when generating the candidate points, instead of perturbing all coordinates simultaneously. Numerical experiments on both synthetic problems and real problems demonstrate the advantages of our new algorithm, compared with many state of the art alternatives.}

📄 PDF Abstract BibTeX arXiv:1410.6271

Code (0)

등록된 구현이 없습니다.

Tasks

global-optimizationSensitivity

Similar Papers 제목 키워드 기반

Discounted Cuts: A Stackelberg Approach to Network Disruption

2025-11-13 · Pål Grønås Drange, Fedor V. Fomin, Petr Golovach, Danil Sagunov arxiv

We study a Stackelberg variant of the classical Most Vital Links problem, modeled as a one-round adversarial game between an attacker and a defender. The attacker strategically removes up to $k$ edges from a flow network…

Optimal Algorithms for Stochastic Bilevel Optimization under Relaxed Smoothness Conditions

2023-06-21 · Xuxing Chen, Tesi Xiao, Krishnakumar Balasubramanian

Stochastic Bilevel optimization usually involves minimizing an upper-level (UL) function that is dependent on the arg-min of a strongly-convex lower-level (LL) function. Several algorithms utilize Neumann series to appro…

Bilevel Optimization

Target-based Surrogates for Stochastic Optimization

2023-02-06 · Jonathan Wilder Lavington, Sharan Vaswani, Reza Babanezhad, Mark Schmidt 외

We consider minimizing functions for which it is expensive to compute the (possibly stochastic) gradient. Such functions are prevalent in reinforcement learning, imitation learning and adversarial training. Our target op…

Imitation LearningStochastic Optimization

Gradient Coding via the Stochastic Block Model

2018-05-25 · Zachary Charles, Dimitris Papailiopoulos

Gradient descent and its many variants, including mini-batch stochastic gradient descent, form the algorithmic foundation of modern large-scale machine learning. Due to the size and scale of modern data, gradient computa…

modelStochastic Block Model

Stability and Generalization of Stochastic Optimization with Nonconvex and Nonsmooth Problems

2022-06-14 · Yunwen Lei

Stochastic optimization has found wide applications in minimizing objective functions in machine learning, which motivates a lot of theoretical studies to understand its practical success. Most of existing studies focus …

Stochastic Optimization