paper-with-me

Papers

Tail Bounds on the Runtime of Categorical Compact Genetic Algorithm

2024-07-10 · Ryoki Hamano, Kento Uchida, Shinichi Shirakawa, Daiki Morinaga, Youhei Akimoto

The majority of theoretical analyses of evolutionary algorithms in the discrete domain focus on binary optimization algorithms, even though black-box optimization on the categorical domain has a lot of practical applications. In this paper, we consider a probabilistic model-based algorithm using the family of categorical distributions as its underlying distribution and set the sample size as two. We term this specific algorithm the categorical compact genetic algorithm (ccGA). The ccGA can be considered as an extension of the compact genetic algorithm (cGA), which is an efficient binary optimization algorithm. We theoretically analyze the dependency of the number of possible categories $K$, the number of dimensions $D$, and the learning rate $\eta$ on the runtime. We investigate the tail bound of the runtime on two typical linear functions on the categorical domain: categorical OneMax (COM) and KVal. We derive that the runtimes on COM and KVal are $O(\sqrt{D} \ln (DK) / \eta)$ and $\Theta(D \ln K/ \eta)$ with high probability, respectively. Our analysis is a generalization for that of the cGA on the binary domain.

📄 PDF Abstract BibTeX arXiv:2407.07388

Code (0)

등록된 구현이 없습니다.

Tasks

Evolutionary Algorithms

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Focus 설명 없음

Similar Papers 제목 키워드 기반

Improved Runtime Analysis of a Multi-Valued Compact Genetic Algorithm on Two Generalized OneMax Problems

2025-03-27 · Sumit Adak, Carsten Witt

Recent research in the runtime analysis of estimation of distribution algorithms (EDAs) has focused on univariate EDAs for multi-valued decision variables. In particular, the runtime of the multi-valued cGA (r-cGA) and U…

Update Strength in EDAs and ACO: How to Avoid Genetic Drift

2016-07-14 · Dirk Sudholt, Carsten Witt

We provide a rigorous runtime analysis concerning the update strength, a vital parameter in probabilistic model-building GAs such as the step size $1/K$ in the compact Genetic Algorithm (cGA) and the evaporation factor $…

global-optimization

Hitting times of local and global optima in genetic algorithms with very high selection pressure

2016-06-18 · Anton Eremeev

The paper is devoted to upper bounds on the expected first hitting times of the sets of local or global optima for non-elitist genetic algorithms with very high selection pressure. The results of this paper extend the ra…

Runtime Analysis of a Multi-Valued Compact Genetic Algorithm on Generalized OneMax

2024-04-17 · Sumit Adak, Carsten Witt

A class of metaheuristic techniques called estimation-of-distribution algorithms (EDAs) are employed in optimization as more sophisticated substitutes for traditional strategies like evolutionary algorithms. EDAs general…

Evolutionary Algorithms

A Tight Runtime Analysis of the $(1+(λ, λ))$ Genetic Algorithm on OneMax

2015-06-19 · Benjamin Doerr, Carola Doerr

Understanding how crossover works is still one of the big challenges in evolutionary computation research, and making our understanding precise and proven by mathematical means might be an even bigger one. As one of few …