paper-with-me

Papers

Can Large Language Models Be Trusted as Black-Box Evolutionary Optimizers for Combinatorial Problems?

2025-01-25 · Jie Zhao, Tao Wen, Kang Hao Cheong

Evolutionary computation excels in complex optimization but demands deep domain knowledge, restricting its accessibility. Large Language Models (LLMs) offer a game-changing solution with their extensive knowledge and could democratize the optimization paradigm. Although LLMs possess significant capabilities, they may not be universally effective, particularly since evolutionary optimization encompasses multiple stages. It is therefore imperative to evaluate the suitability of LLMs as evolutionary optimizer (EVO). Thus, we establish a series of rigid standards to thoroughly examine the fidelity of LLM-based EVO output in different stages of evolutionary optimization and then introduce a robust error-correction mechanism to mitigate the output uncertainty. Furthermore, we explore a cost-efficient method that directly operates on entire populations with excellent effectiveness in contrast to individual-level optimization. Through extensive experiments, we rigorously validate the performance of LLMs as operators targeted for combinatorial problems. Our findings provide critical insights and valuable observations, advancing the understanding and application of LLM-based optimization.

📄 PDF Abstract BibTeX arXiv:2501.15081

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

CoNES: Convex Natural Evolutionary Strategies

2020-07-16 · Sushant Veer, Anirudha Majumdar

We present a novel algorithm -- convex natural evolutionary strategies (CoNES) -- for optimizing high-dimensional blackbox functions by leveraging tools from convex optimization and information geometry. CoNES is formula…

BenchmarkingMuJoCoreinforcement-learningReinforcement Learning (RL)

Introducing Elitist Black-Box Models: When Does Elitist Selection Weaken the Performance of Evolutionary Algorithms?

2015-08-27 · Carola Doerr, Johannes Lengler

Black-box complexity theory provides lower bounds for the runtime of black-box optimizers like evolutionary algorithms and serves as an inspiration for the design of new genetic algorithms. Several black-box models cover…

Evolutionary Algorithms

Large Language Model-Based Evolutionary Optimizer: Reasoning with elitism

2024-03-04 · Shuvayan Brahmachary, Subodh M. Joshi, Aniruddha Panda, Kaushik Koneripalli 외

Large Language Models (LLMs) have demonstrated remarkable reasoning abilities, prompting interest in their application as black-box optimizers. This paper asserts that LLMs possess the capability for zero-shot optimizati…

Language ModelingLanguage ModellingLarge Language Model

Topic Modelling Black Box Optimization

2025-12-18 · Roman Akramov, Artem Khamatullin, Svetlana Glazyrina, Maksim Kryzhanovskiy 외 arxiv

Choosing the number of topics $T$ in Latent Dirichlet Allocation (LDA) is a key design decision that strongly affects both the statistical fit and interpretability of topic models. In this work, we formulate the selectio…

Topic Models

Task-free Adaptive Meta Black-box Optimization

2026-01-29 · Chao Wang, Licheng Jiao, Lingling Li, Jiaxuan Zhao 외 arxiv

Handcrafted optimizers become prohibitively inefficient for complex black-box optimization (BBO) tasks. MetaBBO addresses this challenge by meta-learning to automatically configure optimizers for low-level BBO tasks, the…