paper-with-me

홈 › Papers

Stochastic Runtime Analysis of a Cross Entropy Algorithm for Traveling Salesman Problems

2016-12-21 · Zijun Wu, Rolf Moehring, Jianhui Lai

This article analyzes the stochastic runtime of a Cross-Entropy Algorithm on two classes of traveling salesman problems. The algorithm shares main features of the famous Max-Min Ant System with iteration-best reinforcement. For simple instances that have a $\{1,n\}$-valued distance function and a unique optimal solution, we prove a stochastic runtime of $O(n^{6+\epsilon})$ with the vertex-based random solution generation, and a stochastic runtime of $O(n^{3+\epsilon}\ln n)$ with the edge-based random solution generation for an arbitrary $\epsilon\in (0,1)$. These runtimes are very close to the known expected runtime for variants of Max-Min Ant System with best-so-far reinforcement. They are obtained for the stronger notion of stochastic runtime, which means that an optimal solution is obtained in that time with an overwhelming probability, i.e., a probability tending exponentially fast to one with growing problem size. We also inspect more complex instances with $n$ vertices positioned on an $m\times m$ grid. When the $n$ vertices span a convex polygon, we obtain a stochastic runtime of $O(n^{3}m^{5+\epsilon})$ with the vertex-based random solution generation, and a stochastic runtime of $O(n^{2}m^{5+\epsilon})$ for the edge-based random solution generation. When there are $k = O(1)$ many vertices inside a convex polygon spanned by the other $n-k$ vertices, we obtain a stochastic runtime of $O(n^{4}m^{5+\epsilon}+n^{6k-1}m^{\epsilon})$ with the vertex-based random solution generation, and a stochastic runtime of $O(n^{3}m^{5+\epsilon}+n^{3k}m^{\epsilon})$ with the edge-based random solution generation. These runtimes are better than the expected runtime for the so-called $(\mu\!+\!\lambda)$ EA reported in a recent article, and again obtained for the stronger notion of stochastic runtime.

📄 PDF Abstract BibTeX arXiv:1612.06962

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Better Runtime Guarantees Via Stochastic Domination

2018-01-13 · Benjamin Doerr

Apart from few exceptions, the mathematical runtime analysis of evolutionary algorithms is mostly concerned with expected runtimes. In this work, we argue that stochastic domination is a notion that should be used more f…

Evolutionary Algorithms

Cross-Entropy Optimization for Hyperparameter Optimization in Stochastic Gradient-based Approaches to Train Deep Neural Networks

2024-09-14 · Kevin Li, Fulu Li

In this paper, we present a cross-entropy optimization method for hyperparameter optimization in stochastic gradient-based approaches to train deep neural networks. The value of a hyperparameter of a learning algorithm o…

Hyperparameter OptimizationStochastic Optimization

Already Moderate Population Sizes Provably Yield Strong Robustness to Noise

2024-04-02 · Denis Antipov, Benjamin Doerr, Alexandra Ivanova

Experience shows that typical evolutionary algorithms can cope well with stochastic disturbances such as noisy function evaluations. In this first mathematical runtime analysis of the $(1+\lambda)$ and $(1,\lambda)$ evol…

Evolutionary Algorithms

Analysis of Evolutionary Algorithms in Dynamic and Stochastic Environments

2018-06-22 · Vahid Roostapour, Mojgan Pourhassan, Frank Neumann

Many real-world optimization problems occur in environments that change dynamically or involve stochastic components. Evolutionary algorithms and other bio-inspired algorithms have been widely applied to dynamic and stoc…

Evolutionary Algorithms

Sinkhorn doubly stochastic attention rank decay analysis

2026-04-09 · Michela Lapenna, Rita Fioresi, Bahman Gharesifard arxiv

The self-attention mechanism is central to the success of Transformer architectures. However, standard row-stochastic attention has been shown to suffer from significant signal degradation across layers. In particular, i…

Image ClassificationSentiment Analysis