paper-with-me

Papers

AlgoSelect: Universal Algorithm Selection via the Comb Operator

2025-06-17 · Jasper Yao

We introduce AlgoSelect, a principled framework for learning optimal algorithm selection from data, centered around the novel Comb Operator. Given a set of algorithms and a feature representation of problems, AlgoSelect learns to interpolate between diverse computational approaches. For pairs of algorithms, a simple sigmoid-gated selector, an instance of the Comb Operator, facilitates this interpolation. We extend this to an N-Path Comb for multiple algorithms. We prove that this framework is universal (can approximate any algorithm selector), information-theoretically optimal in its learnability (thresholds for selection converge almost surely, demonstrated via Borel-Cantelli arguments), computationally efficient, and robust. Key theoretical contributions include: (1) a universal approximation theorem demonstrating that Comb-based selectors can achieve arbitrary accuracy; (2) information-theoretic learnability for selection thresholds; (3) formalization of the Comb Operator within linear operator theory, detailing its boundedness and spectral properties; (4) an N-Path Comb generalization for multi-algorithm selection; and (5) a practical learning framework for the adaptive seeding functions that guide the Comb Operator. Empirical validation on a comprehensive 20$\times$20 problem-algorithm study demonstrates near-perfect selection (99.9\%+ accuracy) with remarkably few samples and rapid convergence, revealing that $H(\text{Algorithm}|\text{Problem}) \approx 0$ in structured domains. AlgoSelect provides a theoretically grounded, practically deployable solution to automated algorithm selection with provable optimality and learnability guarantees, with significant implications for AI and adaptive systems.

📄 PDF Abstract BibTeX arXiv:2506.17304

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

A novel mutation operator based on the union of fitness and design spaces information for Differential Evolution

2015-10-08 · H. Sharifi Noghabi, H. Rajabi Mashhadi, K. Shojaei

Differential Evolution (DE) is one of the most successful and powerful evolutionary algorithms for global optimization problem. The most important operator in this algorithm is mutation operator which parents are selecte…

Evolutionary Algorithmsglobal-optimization

On the Success Rate of Crossover Operators for Genetic Programming with Offspring Selection

2013-09-23 · Gabriel Kronberger, Stephan Winkler, Michael Affenzeller, Andreas Beham 외

Genetic programming is a powerful heuristic search technique that is used for a number of real world applications to solve among others regression, classification, and time-series forecasting problems. A lot of progress …

Heuristic SearchTime SeriesTime Series AnalysisTime Series Forecasting

Geometry-Aware Universal Mirror-Prox

2020-11-23 · Reza Babanezhad, Simon Lacoste-Julien

Mirror-prox (MP) is a well-known algorithm to solve variational inequality (VI) problems. VI with a monotone operator covers a large group of settings such as convex minimization, min-max or saddle point problems. To get…

K-Bit-Swap: A New Operator For Real-Coded Evolutionary Algorithms

2016-04-22 · Aram Ter-Sarkisov, Stephen Marsland

There has been a variety of crossover operators proposed for Real-Coded Genetic Algorithms (RCGAs), which recombine values from the same location in pairs of strings. In this article we present a recombination operator f…

ClusteringEvolutionary Algorithms

Information-geometric optimization with natural selection

2019-12-06 · Jakub Otwinowski, Colin LaMont

Evolutionary algorithms, inspired by natural evolution, aim to optimize difficult objective functions without computing derivatives. Here we detail the relationship between population genetics and evolutionary optimizati…

Evolutionary Algorithms