paper-with-me

홈 › Papers

Faster Optimization Through Genetic Drift

2024-04-18 · Cella Florescu, Marc Kaufmann, Johannes Lengler, Ulysse Schaller

The compact Genetic Algorithm (cGA), parameterized by its hypothetical population size $K$, offers a low-memory alternative to evolving a large offspring population of solutions. It evolves a probability distribution, biasing it towards promising samples. For the classical benchmark OneMax, the cGA has to two different modes of operation: a conservative one with small step sizes $\Theta(1/(\sqrt{n}\log n))$, which is slow but prevents genetic drift, and an aggressive one with large step sizes $\Theta(1/\log n)$, in which genetic drift leads to wrong decisions, but those are corrected efficiently. On OneMax, an easy hill-climbing problem, both modes lead to optimization times of $\Theta(n\log n)$ and are thus equally efficient. In this paper we study how both regimes change when we replace OneMax by the harder hill-climbing problem DynamicBinVal. It turns out that the aggressive mode is not affected and still yields quasi-linear runtime $O(n\cdot polylog (n))$. However, the conservative mode becomes substantially slower, yielding a runtime of $\Omega(n^2)$, since genetic drift can only be avoided with smaller step sizes of $O(1/n)$. We complement our theoretical results with simulations.

📄 PDF Abstract BibTeX arXiv:2404.12147

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Genetic Drift Regularization: on preventing Actor Injection from breaking Evolution Strategies

2024-05-07 · Paul Templier, Emmanuel Rachelson, Antoine Cully, Dennis G. Wilson

Evolutionary Algorithms (EA) have been successfully used for the optimization of neural networks for policy search, but they still remain sample inefficient and underperforming in some cases compared to gradient-based re…

Evolutionary AlgorithmsReinforcement Learning (RL)

From Understanding Genetic Drift to a Smart-Restart Mechanism for Estimation-of-Distribution Algorithms

2022-06-18 · Weijie Zheng, Benjamin Doerr

Estimation-of-distribution algorithms (EDAs) are optimization algorithms that learn a distribution on the search space from which good solutions can be sampled easily. A key parameter of most EDAs is the sample size (pop…

Combinatorial Optimization

A Reinforced Evolution-Based Approach to Multi-Resource Load Balancing

2025-11-06 · Leszek Sliwko arxiv

This paper presents a reinforced genetic approach to a defined d-resource system optimization problem. The classical evolution schema was ineffective due to a very strict feasibility function in the studied problem. Henc…

Level-Based Analysis of Genetic Algorithms for Combinatorial Optimization

2015-12-07 · Duc-Cuong Dang, Anton V. Eremeev, Per Kristian Lehre

The paper is devoted to upper bounds on run-time of Non-Elitist Genetic Algorithms until some target subset of solutions is visited for the first time. In particular, we consider the sets of optimal solutions and the set…

Combinatorial Optimization

From Understanding Genetic Drift to a Smart-Restart Parameter-less Compact Genetic Algorithm

2020-04-15 · Benjamin Doerr, Weijie Zheng

One of the key difficulties in using estimation-of-distribution algorithms is choosing the population size(s) appropriately: Too small values lead to genetic drift, which can cause enormous difficulties. In the regime wi…