paper-with-me

홈 › Papers

AutoEP: LLMs-Driven Automation of Hyperparameter Evolution for Metaheuristic Algorithms

2025-09-27 · Zhenxing Xu, Yizhe Zhang, Weidong Bao, Hao Wang, Ming Chen, Haoran Ye, Wenzheng Jiang, Hui Yan, Ji Wang arxiv

Dynamically configuring algorithm hyperparameters is a fundamental challenge in computational intelligence. While learning-based methods offer automation, they suffer from prohibitive sample complexity and poor generalization. We introduce AutoEP, a novel framework that bypasses training entirely by leveraging Large Language Models (LLMs) as zero-shot reasoning engines for algorithm control. AutoEP's core innovation lies in a tight synergy between two components: (1) an online Exploratory Landscape Analysis (ELA) module that provides real-time, quantitative feedback on the search dynamics, and (2) a multi-LLM reasoning chain that interprets this feedback to generate adaptive hyperparameter strategies. This approach grounds high-level reasoning in empirical data, mitigating hallucination. Evaluated on three distinct metaheuristics across diverse combinatorial optimization benchmarks, AutoEP consistently outperforms state-of-the-art tuners, including neural evolution and other LLM-based methods. Notably, our framework enables open-source models like Qwen3-30B to match the performance of GPT-4, demonstrating a powerful and accessible new paradigm for automated hyperparameter design. Our code is available at https://github.com/YiZheZhang12/AutoEP.

📄 PDF Abstract BibTeX arXiv:2509.23189

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

An Adaptive and Near Parameter-free Evolutionary Computation Approach Towards True Automation in AutoML

2020-01-28 · Benjamin Patrick Evans, Bing Xue, Mengjie Zhang

A common claim of evolutionary computation methods is that they can achieve good results without the need for human intervention. However, one criticism of this is that there are still hyperparameters which must be tuned…

AutoML

Implementing Default and Autoepistemic Logics via the Logic of GK

2014-05-05 · Jianmin Ji, Hannes Strass

The logic of knowledge and justified assumptions, also known as logic of grounded knowledge (GK), was proposed by Lin and Shoham as a general logic for nonmonotonic reasoning. To date, it has been used to embed in it def…

Translation

LLM Guided Evolution - The Automation of Models Advancing Models

2024-03-18 · Clint Morris, Michael Jurado, Jason Zutty

In the realm of machine learning, traditional model development and automated approaches like AutoML typically rely on layers of abstraction, such as tree-based or Cartesian genetic programming. Our study introduces "Gui…

AutoMLDecision MakingEvolutionary Algorithms

An investigation on the use of Large Language Models for hyperparameter tuning in Evolutionary Algorithms

2024-08-05 · Leonardo Lucio Custode, Fabio Caraffini, Anil Yaman, Giovanni Iacca

Hyperparameter optimization is a crucial problem in Evolutionary Computation. In fact, the values of the hyperparameters directly impact the trajectory taken by the optimization process, and their choice requires extensi…

Evolutionary AlgorithmsHyperparameter Optimization

Merging in a Bottle: Differentiable Adaptive Merging (DAM) and the Path from Averaging to Automation

2024-10-10 · Thomas Gauthier-Caron, Shamane Siriwardhana, Elliot Stein, Malikeh Ehghaghi 외

By merging models, AI systems can combine the distinct strengths of separate language models, achieving a balance between multiple capabilities without requiring substantial retraining. However, the integration process c…