paper-with-me

홈 › Papers

From Understanding Genetic Drift to a Smart-Restart Parameter-less Compact Genetic Algorithm

2020-04-15 · Benjamin Doerr, Weijie Zheng

One of the key difficulties in using estimation-of-distribution algorithms is choosing the population size(s) appropriately: Too small values lead to genetic drift, which can cause enormous difficulties. In the regime with no genetic drift, however, often the runtime is roughly proportional to the population size, which renders large population sizes inefficient. Based on a recent quantitative analysis which population sizes lead to genetic drift, we propose a parameter-less version of the compact genetic algorithm that automatically finds a suitable population size without spending too much time in situations unfavorable due to genetic drift. We prove a mathematical runtime guarantee for this algorithm and conduct an extensive experimental analysis on four classic benchmark problems both without and with additive centered Gaussian posterior noise. The former shows that under a natural assumption, our algorithm has a performance very similar to the one obtainable from the best problem-specific population size. The latter confirms that missing the right population size in the original cGA can be detrimental and that previous theory-based suggestions for the population size can be far away from the right values; it also shows that our algorithm as well as a previously proposed parameter-less variant of the cGA based on parallel runs avoid such pitfalls. Comparing the two parameter-less approaches, ours profits from its ability to abort runs which are likely to be stuck in a genetic drift situation.

📄 PDF Abstract BibTeX arXiv:2004.07141

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

From Understanding Genetic Drift to a Smart-Restart Mechanism for Estimation-of-Distribution Algorithms

2022-06-18 · Weijie Zheng, Benjamin Doerr

Estimation-of-distribution algorithms (EDAs) are optimization algorithms that learn a distribution on the search space from which good solutions can be sampled easily. A key parameter of most EDAs is the sample size (pop…

Combinatorial Optimization

Estimation-of-Distribution Algorithms for Multi-Valued Decision Variables

2023-02-28 · Firas Ben Jedidia, Benjamin Doerr, Martin S. Krejca

The majority of research on estimation-of-distribution algorithms (EDAs) concentrates on pseudo-Boolean optimization and permutation problems, leaving the domain of EDAs for problems in which the decision variables can t…

Fail-Fast, Restart-Smart: Early Failure Prediction and Restart for SWE Agentic Tasks

2026-08-04 · Chenyu Wang, Yunbo Lyu, Junda He, Zhou Yang 외 arxiv

Software engineering (SWE) agents resolve repository-level issues through long trajectories that grow increasingly expensive as context accumulates. Failed runs tend to be longer and exhibit redundant exploration or loop…

Nonstationary Reinforcement Learning with Linear Function Approximation

2020-10-08 · Huozhi Zhou, Jinglin Chen, Lav R. Varshney, Ashish Jagmohan

We consider reinforcement learning (RL) in episodic Markov decision processes (MDPs) with linear function approximation under drifting environment. Specifically, both the reward and state transition functions can evolve …

reinforcement-learningReinforcement LearningReinforcement Learning (RL)

Faster Optimization Through Genetic Drift

2024-04-18 · Cella Florescu, Marc Kaufmann, Johannes Lengler, Ulysse Schaller

The compact Genetic Algorithm (cGA), parameterized by its hypothetical population size $K$, offers a low-memory alternative to evolving a large offspring population of solutions. It evolves a probability distribution, bi…