paper-with-me

홈 › Papers

On the Limitations of the Univariate Marginal Distribution Algorithm to Deception and Where Bivariate EDAs might help

2019-07-29 · Per Kristian Lehre, Phan Trung Hai Nguyen

We introduce a new benchmark problem called Deceptive Leading Blocks (DLB) to rigorously study the runtime of the Univariate Marginal Distribution Algorithm (UMDA) in the presence of epistasis and deception. We show that simple Evolutionary Algorithms (EAs) outperform the UMDA unless the selective pressure $\mu/\lambda$ is extremely high, where $\mu$ and $\lambda$ are the parent and offspring population sizes, respectively. More precisely, we show that the UMDA with a parent population size of $\mu=\Omega(\log n)$ has an expected runtime of $e^{\Omega(\mu)}$ on the DLB problem assuming any selective pressure $\frac{\mu}{\lambda} \geq \frac{14}{1000}$, as opposed to the expected runtime of $\mathcal{O}(n\lambda\log \lambda+n^3)$ for the non-elitist $(\mu,\lambda)~\text{EA}$ with $\mu/\lambda\leq 1/e$. These results illustrate inherent limitations of univariate EDAs against deception and epistasis, which are common characteristics of real-world problems. In contrast, empirical evidence reveals the efficiency of the bi-variate MIMIC algorithm on the DLB problem. Our results suggest that one should consider EDAs with more complex probabilistic models when optimising problems with some degree of epistasis and deception.

📄 PDF Abstract BibTeX arXiv:1907.12438

Code (0)

등록된 구현이 없습니다.

Tasks

Evolutionary Algorithms

Similar Papers 제목 키워드 기반

The Univariate Marginal Distribution Algorithm Copes Well With Deception and Epistasis

2020-07-16 · Benjamin Doerr, Martin S. Krejca

In their recent work, Lehre and Nguyen (FOGA 2019) show that the univariate marginal distribution algorithm (UMDA) needs time exponential in the parent populations size to optimize the DeceptiveLeadingBlocks (DLB) proble…

Evolutionary Algorithms

General Univariate Estimation-of-Distribution Algorithms

2022-06-22 · Benjamin Doerr, Marc Dufay

We propose a general formulation of a univariate estimation-of-distribution algorithm (EDA). It naturally incorporates the three classic univariate EDAs \emph{compact genetic algorithm}, \emph{univariate marginal distrib…

Incremental Learning

Upper Bounds on the Runtime of the Univariate Marginal Distribution Algorithm on OneMax

2017-03-31 · Carsten Witt

A runtime analysis of the Univariate Marginal Distribution Algorithm (UMDA) is presented on the OneMax function for wide ranges of its parameters $\mu$ and $\lambda$. If $\mu\ge c\log n$ for some constant $c>0$ and $\lam…

A Simplified Run Time Analysis of the Univariate Marginal Distribution Algorithm on LeadingOnes

2020-04-10 · Benjamin Doerr, Martin Krejca

With elementary means, we prove a stronger run time guarantee for the univariate marginal distribution algorithm (UMDA) optimizing the LeadingOnes benchmark function in the desirable regime with low genetic drift. If the…

Improved Runtime Bounds for the Univariate Marginal Distribution Algorithm via Anti-Concentration

2018-02-02 · Per Kristian Lehre, Phan Trung Hai Nguyen

Unlike traditional evolutionary algorithms which produce offspring via genetic operators, Estimation of Distribution Algorithms (EDAs) sample solutions from probabilistic models which are learned from selected individual…

Evolutionary Algorithms