Achieving Tight $O(4^k)$ Runtime Bounds on Jump$_k$ by Proving that Genetic Algorithms Evolve Near-Maximal Population Diversity
The JUMP$_k$ benchmark was the first problem for which crossover was proven to give a speed-up over mutation-only evolutionary algorithms. Jansen and Wegener (2002) proved an upper bound of $O(\text{poly}(n) + 4^k/p_c)$ for the ($\mu$+1) Genetic Algorithm ($(\mu+1)$ GA), but only for unrealistically small crossover probabilities $p_c$. To this date, it remains an open problem to prove similar upper bounds for realistic $p_c$; the best known runtime bound, in terms of function evaluations, for $p_c = \Omega(1)$ is $O((n/\chi)^{k-1})$, $\chi$ a positive constant. We provide a novel approach and analyse the evolution of the population diversity, measured as sum of pairwise Hamming distances, for a variant of the $(\mu+1)$ GA on JUMP$_k$. The $(\mu+1)$-$\lambda_c$-GA creates one offspring in each generation either by applying mutation to one parent or by applying crossover $\lambda_c$ times to the same two parents (followed by mutation), to amplify the probability of creating an accepted offspring in generations with crossover. We show that population diversity in the $(\mu+1)$-$\lambda_c$-GA converges to an equilibrium of near-perfect diversity. This yields an improved time bound of $O(\mu n \log(\mu) + 4^k)$ function evaluations for a range of $k$ under the mild assumptions $p_c = O(1/k)$ and $\mu \in \Omega(kn)$. For all constant $k$, the restriction is satisfied for some $p_c = \Omega(1)$ and it implies that the expected runtime for all constant $k$ and an appropriate $\mu = \Theta(kn)$ is bounded by $O(n^2 \log n)$, irrespective of $k$. For larger $k$, the expected time of the $(\mu+1)$-$\lambda_c$-GA is $\Theta(4^k)$, which is tight for a large class of unbiased black-box algorithms and faster than the original $(\mu+1)$ GA by a factor of $\Omega(1/p_c)$. We also show that our analysis can be extended to other unitation functions such as JUMP$_{k, \delta}$ and HURDLE.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversityEvolutionary AlgorithmsSimilar Papers 제목 키워드 기반
From Understanding the Population Dynamics of the NSGA-II to the First Proven Lower Bounds
Due to the more complicated population dynamics of the NSGA-II, none of the existing runtime guarantees for this algorithm is accompanied by a non-trivial lower bound. Via a first mathematical understanding of the popula…
Near-Tight Runtime Guarantees for Many-Objective Evolutionary Algorithms
Despite significant progress in the field of mathematical runtime analysis of multi-objective evolutionary algorithms (MOEAs), the performance of MOEAs on discrete many-objective problems is little understood. In particu…
Evolutionary AlgorithmsA Tight Runtime Analysis for the cGA on Jump Functions---EDAs Can Cross Fitness Valleys at No Extra Cost
We prove that the compact genetic algorithm (cGA) with hypothetical population size $\mu = \Omega(\sqrt n \log n) \cap \text{poly}(n)$ with high probability finds the optimum of any $n$-dimensional jump function with jum…
Evolutionary AlgorithmsvalidLower Bounds from Fitness Levels Made Easy
One of the first and easy to use techniques for proving run time bounds for evolutionary algorithms is the so-called method of fitness levels by Wegener. It uses a partition of the search space into a sequence of levels …
Evolutionary AlgorithmsAsymptotical Analysis of the $(1+(λ,λ))$ GA Escape Time from Local Optima on Jump Functions
The paper develops the approach to the runtime analysis of evolutionary algorithms on the basis of limit theorems from probability theory. We consider the family of Jump$_k$ benchmark functions, defined on the search spa…