paper-with-me

홈 › Papers

Level-Based Analysis of the Univariate Marginal Distribution Algorithm

2018-07-26 · Duc-Cuong Dang, Per Kristian Lehre, Phan Trung Hai Nguyen

Estimation of Distribution Algorithms (EDAs) are stochastic heuristics that search for optimal solutions by learning and sampling from probabilistic models. Despite their popularity in real-world applications, there is little rigorous understanding of their performance. Even for the Univariate Marginal Distribution Algorithm (UMDA) -- a simple population-based EDA assuming independence between decision variables -- the optimisation time on the linear problem OneMax was until recently undetermined. The incomplete theoretical understanding of EDAs is mainly due to lack of appropriate analytical tools. We show that the recently developed level-based theorem for non-elitist populations combined with anti-concentration results yield upper bounds on the expected optimisation time of the UMDA. This approach results in the bound $\mathcal{O}(n\lambda\log \lambda+n^2)$ on two problems, LeadingOnes and BinVal, for population sizes $\lambda>\mu=\Omega(\log n)$, where $\mu$ and $\lambda$ are parameters of the algorithm. We also prove that the UMDA with population sizes $\mu\in \mathcal{O}(\sqrt{n}) \cap \Omega(\log n)$ optimises OneMax in expected time $\mathcal{O}(\lambda n)$, and for larger population sizes $\mu=\Omega(\sqrt{n}\log n)$, in expected time $\mathcal{O}(\lambda\sqrt{n})$. The facility and generality of our arguments suggest that this is a promising approach to derive bounds on the expected optimisation time of EDAs.

📄 PDF Abstract BibTeX arXiv:1807.10038

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A Simplified Run Time Analysis of the Univariate Marginal Distribution Algorithm on LeadingOnes

2020-04-10 · Benjamin Doerr, Martin Krejca

With elementary means, we prove a stronger run time guarantee for the univariate marginal distribution algorithm (UMDA) optimizing the LeadingOnes benchmark function in the desirable regime with low genetic drift. If the…

General Univariate Estimation-of-Distribution Algorithms

2022-06-22 · Benjamin Doerr, Marc Dufay

We propose a general formulation of a univariate estimation-of-distribution algorithm (EDA). It naturally incorporates the three classic univariate EDAs \emph{compact genetic algorithm}, \emph{univariate marginal distrib…

Incremental Learning

Improved Runtime Bounds for the Univariate Marginal Distribution Algorithm via Anti-Concentration

2018-02-02 · Per Kristian Lehre, Phan Trung Hai Nguyen

Unlike traditional evolutionary algorithms which produce offspring via genetic operators, Estimation of Distribution Algorithms (EDAs) sample solutions from probabilistic models which are learned from selected individual…

Evolutionary Algorithms

Upper Bounds on the Runtime of the Univariate Marginal Distribution Algorithm on OneMax

2017-03-31 · Carsten Witt

A runtime analysis of the Univariate Marginal Distribution Algorithm (UMDA) is presented on the OneMax function for wide ranges of its parameters $\mu$ and $\lambda$. If $\mu\ge c\log n$ for some constant $c>0$ and $\lam…

Runtime Analysis of the Univariate Marginal Distribution Algorithm under Low Selective Pressure and Prior Noise

2019-04-19 · Per Kristian Lehre, Phan Trung Hai Nguyen

We perform a rigorous runtime analysis for the Univariate Marginal Distribution Algorithm on the LeadingOnes function, a well-known benchmark function in the theory community of evolutionary computation with a high corre…