paper-with-me

홈 › Papers

Anytime Analysis on BinVal: Adaptive Parameters Help

2026-04-08 · Timo Kötzing, Jurek Sander arxiv

While most theoretical run time analyses of discrete randomized search heuristics provide bounds on the expected number of evaluations to find the global optimum, we consider the anytime performance of evolutionary and estimation-of-distribution algorithms. For this purpose, we analyze the fixed-target run time of various algorithms using BinVal as fitness function and bound the run time to optimize the most significant $k \in o(n)$ bits of a bit string with length $n$. We analyze the run times such that they hold not only for a fixed $k$, but simultaneously for all $k \in o(n)$. For the standard (1+1) EA with fixed mutation rate $1/n$, we show that the fixed-target run time for all $k \in o(n)$ is in $Θ(n \log k)$. Using an EDA instead, we get an expected number of evaluations of $Θ(k \log n)$ for the sig-cGA. Replacing in the standard (1+1) EA the fixed mutation rate with a self-adjusting rate, we show that the fixed-target run time for $k \in o(n)$ and a constant $\varepsilon >0$ arbitrarily close to zero is in $\mathcal{O}\left(k^{1+\varepsilon}\right)$ for this algorithm. In particular, this run time is independent of $n$, holds simultaneously for all $k \in o(n)$, and is close to the run time of $Θ(k \log k)$ for the (1+1) EA with the best fixed mutation rate if $k$ is known.

📄 PDF Abstract BibTeX arXiv:2604.06976

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Runtime analysis of the (mu+1)-EA on the Dynamic BinVal function

2020-10-26 · Johannes Lengler, Simone Riedi

We study evolutionary algorithms in a dynamic setting, where for each generation a different fitness function is chosen, and selection is performed with respect to the current fitness function. Specifically, we consider …

Evolutionary Algorithms

Improved Runtime Bound for the $(μ+ 1)$ EA on BinVal

2026-06-11 · Joris Belder, Johannes Lengler, Raghu Raman Ravi arxiv

We study the $(μ+1)$ EA on the Binary Value function BinVal. We show that it needs at most $O(μ\log μ\cdot n \log n)$ function evaluations to find the optimum when $μ= o(n/\log n)$. This substantially improves upon the r…

TIPS: Topologically Important Path Sampling for Anytime Neural Networks

2023-05-13 · Guihong Li, Kartikeya Bhardwaj, Yuedong Yang, Radu Marculescu

Anytime neural networks (AnytimeNNs) are a promising solution to adaptively adjust the model complexity at runtime under various hardware resource constraints. However, the manually-designed AnytimeNNs are biased by desi…

Level-Based Analysis of the Population-Based Incremental Learning Algorithm

2018-06-05 · Per Kristian Lehre, Phan Trung Hai Nguyen

The Population-Based Incremental Learning (PBIL) algorithm uses a convex combination of the current model and the empirical model to construct the next model, which is then sampled to generate offspring. The Univariate M…

Incremental Learning

Learning Anytime Predictions in Neural Networks via Adaptive Loss Balancing

2017-08-22 · Hanzhang Hu, Debadeepta Dey, Martial Hebert, J. Andrew Bagnell

This work considers the trade-off between accuracy and test-time computational cost of deep neural networks (DNNs) via \emph{anytime} predictions from auxiliary predictions. Specifically, we optimize auxiliary losses joi…