paper-with-me

홈 › Papers

Sharp Bounds on the Runtime of the (1+1) EA via Drift Analysis and Analytic Combinatorial Tools

2019-06-21 · Hsien-Kuei Hwang, Carsten Witt

The expected running time of the classical (1+1) EA on the OneMax benchmark function has recently been determined by Hwang et al. (2018) up to additive errors of $O((\log n)/n)$. The same approach proposed there also leads to a full asymptotic expansion with errors of the form $O(n^{-K}\log n)$ for any $K>0$. This precise result is obtained by matched asymptotics with rigorous error analysis (or by solving asymptotically the underlying recurrences via inductive approximation arguments), ideas radically different from well-established techniques for the running time analysis of evolutionary computation such as drift analysis. This paper revisits drift analysis for the (1+1) EA on OneMax and obtains that the expected running time $E(T)$, starting from $\lceil n/2\rceil$ one-bits, is determined by the sum of inverse drifts up to logarithmic error terms, more precisely $$\sum_{k=1}^{\lfloor n/2\rfloor}\frac{1}{\Delta(k)} - c_1\log n \le E(T) \le \sum_{k=1}^{\lfloor n/2\rfloor}\frac{1}{\Delta(k)} - c_2\log n,$$ where $\Delta(k)$ is the drift (expected increase of the number of one-bits from the state of $n-k$ ones) and $c_1,c_2 >0$ are explicitly computed constants. This improves the previous asymptotic error known for the sum of inverse drifts from $\tilde{O}(n^{2/3})$ to a logarithmic error and gives for the first time a non-asymptotic error bound. Using standard asymptotic techniques, the difference between $E(T)$ and the sum of inverse drifts is found to be $(e/2)\log n+O(1)$.

📄 PDF Abstract BibTeX arXiv:1906.09047

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

General Drift Analysis with Tail Bounds

2013-07-09 · Per Kristian Lehre, Carsten Witt

Drift analysis is one of the state-of-the-art techniques for the runtime analysis of randomized search heuristics (RSHs) such as evolutionary algorithms (EAs), simulated annealing etc. The vast majority of existing drift…

Evolutionary Algorithms

Concentration Tail-Bound Analysis of Coevolutionary and Bandit Learning Algorithms

2024-05-07 · Per Kristian Lehre, Shishen Lin

Runtime analysis, as a branch of the theory of AI, studies how the number of iterations algorithms take before finding a solution (its runtime) depends on the design of the algorithm and the problem structure. Drift anal…

On the Provable Suboptimality of Momentum SGD in Nonstationary Stochastic Optimization

2026-01-18 · Sharan Sahu, Cameron J. Hogan, Martin T. Wells arxiv

In this paper, we provide a comprehensive theoretical analysis of Stochastic Gradient Descent (SGD) and its momentum variants (Polyak Heavy-Ball and Nesterov) for tracking time-varying optima under strong convexity and s…

Stochastic Optimization

Drift Theory in Continuous Search Spaces: Expected Hitting Time of the (1+1)-ES with 1/5 Success Rule

2018-02-09 · Youhei Akimoto, Anne Auger, Tobias Glasmachers

This paper explores the use of the standard approach for proving runtime bounds in discrete domains---often referred to as drift analysis---in the context of optimization on a continuous domain. Using this framework we a…

Sharper Regret Bounds for Time-Varying Gaussian Process Bandits with Constant Exploration

2026-08-19 · Matthias Mandl, Hanne Kekkonen arxiv

We study Bayesian optimization in a time-varying environment where the unknown reward function evolves according to a Gaussian process drift model. Existing GP-UCB analyses in this setting typically require the explorati…