Automatic Prompt Optimization via Heuristic Search: A Survey
Recent advances in Large Language Models have led to remarkable achievements across a variety of Natural Language Processing tasks, making prompt engineering increasingly central to guiding model outputs. While manual methods can be effective, they typically rely on intuition and do not automatically refine prompts over time. In contrast, automatic prompt optimization employing heuristic-based search algorithms can systematically explore and improve prompts with minimal human oversight. This survey proposes a comprehensive taxonomy of these methods, categorizing them by where optimization occurs, what is optimized, what criteria drive the optimization, which operators generate new prompts, and which iterative search algorithms are applied. We further highlight specialized datasets and tools that support and accelerate automated prompt refinement. We conclude by discussing key open challenges pointing toward future opportunities for more robust and versatile LLM applications.
Code (0)
등록된 구현이 없습니다.
Tasks
Heuristic SearchPrompt EngineeringSurveySimilar Papers 제목 키워드 기반
HPSS: Heuristic Prompting Strategy Search for LLM Evaluators
Since the adoption of large language models (LLMs) for text evaluation has become increasingly prevalent in the field of natural language processing (NLP), a series of existing works attempt to optimize the prompts for L…
A Survey of Automatic Prompt Engineering: An Optimization Perspective
The rise of foundation models has shifted focus from resource-intensive fine-tuning to prompt engineering, a paradigm that steers model behavior through input design rather than weight updates. While manual prompt engine…
cross-modal alignmentPrompt EngineeringSurveyA Systematic Survey of Automatic Prompt Optimization Techniques
Since the advent of large language models (LLMs), prompt engineering has been a crucial step for eliciting desired responses for various Natural Language Processing (NLP) tasks. However, prompt engineering remains an imp…
Prompt EngineeringSurveyPlum: Prompt Learning using Metaheuristic
Since the emergence of large language models, prompt learning has become a popular method for optimizing and customizing these models. Special prompts, such as Chain-of-Thought, have even revealed previously unknown reas…
Image GenerationPrompt LearningEvolutionary Computation and Large Language Models: A Survey of Methods, Synergies, and Applications
Integrating Large Language Models (LLMs) and Evolutionary Computation (EC) represents a promising avenue for advancing artificial intelligence by combining powerful natural language understanding with optimization and se…
Evolutionary AlgorithmsNatural Language UnderstandingPrompt EngineeringSurvey