paper-with-me

Papers

Large Language Model-Based Evolutionary Optimizer: Reasoning with elitism

2024-03-04 · Shuvayan Brahmachary, Subodh M. Joshi, Aniruddha Panda, Kaushik Koneripalli, Arun Kumar Sagotra, Harshil Patel, Ankush Sharma, Ameya D. Jagtap, Kaushic Kalyanaraman

Large Language Models (LLMs) have demonstrated remarkable reasoning abilities, prompting interest in their application as black-box optimizers. This paper asserts that LLMs possess the capability for zero-shot optimization across diverse scenarios, including multi-objective and high-dimensional problems. We introduce a novel population-based method for numerical optimization using LLMs called Language-Model-Based Evolutionary Optimizer (LEO). Our hypothesis is supported through numerical examples, spanning benchmark and industrial engineering problems such as supersonic nozzle shape optimization, heat transfer, and windfarm layout optimization. We compare our method to several gradient-based and gradient-free optimization approaches. While LLMs yield comparable results to state-of-the-art methods, their imaginative nature and propensity to hallucinate demand careful handling. We provide practical guidelines for obtaining reliable answers from LLMs and discuss method limitations and potential research directions.

📄 PDF Abstract BibTeX arXiv:2403.02054

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage ModellingLarge Language Model

Similar Papers 제목 키워드 기반

Particle Swarm Optimization: A survey of historical and recent developments with hybridization perspectives

2018-04-15 · Saptarshi Sengupta, Sanchita Basak, Richard Alan Peters II

Particle Swarm Optimization (PSO) is a metaheuristic global optimization paradigm that has gained prominence in the last two decades due to its ease of application in unsupervised, complex multidimensional problems which…

global-optimization

When Non-Elitism Meets Time-Linkage Problems

2021-04-14 · Weijie Zheng, Qiaozhi Zhang, Huanhuan Chen, Xin Yao

Many real-world applications have the time-linkage property, and the only theoretical analysis is recently given by Zheng, et al. (TEVC 2021) on their proposed time-linkage OneMax problem, OneMax$_{(0,1^n)}$. However, on…

Evolutionary Algorithms

Non-Elitist Evolutionary Multi-Objective Optimisation: Proof-of-Principle Results

2023-05-26 · Zimin Liang, Miqing Li, Per Kristian Lehre

Elitism, which constructs the new population by preserving best solutions out of the old population and newly-generated solutions, has been a default way for population update since its introduction into multi-objective …

DiversityEvolutionary Algorithms

Derivation of Upper Bounds on Optimization Time of Population-Based Evolutionary Algorithm on a Function with Fitness Plateaus Using Elitism Levels Traverse Mechanism

2012-04-11 · Aram Ter-Sarkisov, Stephen Marsland

In this article a tool for the analysis of population-based EAs is used to derive asymptotic upper bounds on the optimization time of the algorithm solving Royal Roads problem, a test function with plateaus of fitness. I…

Multi-population GAN Training: Analyzing Co-Evolutionary Algorithms

2025-07-17 · Walter P. Casas, Jamal Toutouh

Generative adversarial networks (GANs) are powerful generative models but remain challenging to train due to pathologies suchas mode collapse and instability. Recent research has explored co-evolutionary approaches, in w…

DiversityEvolutionary Algorithms