paper-with-me

홈 › Papers

Automatic Prompt Optimization for Dataset-Level Feature Discovery

2026-01-20 · Adrian Cosma, Oleg Szehr, David Kletz, Alessandro Antonucci, Olivier Pelletier arxiv

Feature extraction from unstructured text is a critical step in many downstream classification pipelines, yet current approaches largely rely on hand-crafted prompts or fixed feature schemas. We formulate feature discovery as a dataset-level prompt optimization problem: given a labelled text corpus, the goal is to induce a global set of interpretable and discriminative feature definitions whose realizations optimize a downstream supervised learning objective. To this end, we propose a multi-agent prompt optimization framework in which language-model agents jointly propose feature definitions, extract feature values, and evaluate feature quality using dataset-level performance and interpretability feedback. Instruction prompts are iteratively refined based on this structured feedback, enabling optimization over prompts that induce shared feature sets rather than per-example predictions. This formulation departs from prior prompt optimization methods that rely on per-sample supervision and provides a principled mechanism for automatic feature discovery from unstructured text.

📄 PDF Abstract BibTeX arXiv:2601.13922

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Bi-Level Prompt Optimization for Multimodal LLM-as-a-Judge

2026-02-11 · Bo Pan, Xuan Kan, Kaitai Zhang, Yan Yan 외 arxiv

Large language models (LLMs) have become widely adopted as automated judges for evaluating AI-generated content. Despite their success, aligning LLM-based evaluations with human judgments remains challenging. While super…

UniAPO: Unified Multimodal Automated Prompt Optimization

2025-08-25 · Qipeng Zhu, Yanzhe Chen, Huasong Zhong, Yan Li 외 arxiv

Prompting is fundamental to unlocking the full potential of large language models. To automate and enhance this process, automatic prompt optimization (APO) has been developed, demonstrating effectiveness primarily in te…

Hard Prompts Made Easy: Gradient-Based Discrete Optimization for Prompt Tuning and Discovery

2023-02-07 · NeurIPS 2023 11 · Yuxin Wen, Neel Jain, John Kirchenbauer, Micah Goldblum 외

The strength of modern generative models lies in their ability to be controlled through text-based prompts. Typical "hard" prompts are made from interpretable words and tokens, and must be hand-crafted by humans. There a…

Automatic Prompt Optimization via Heuristic Search: A Survey

2025-02-26 · Wendi Cui, Jiaxin Zhang, Zhuohang Li, Hao Sun 외

Recent advances in Large Language Models have led to remarkable achievements across a variety of Natural Language Processing tasks, making prompt engineering increasingly central to guiding model outputs. While manual me…

Heuristic SearchPrompt EngineeringSurvey

GRAD-SUM: Leveraging Gradient Summarization for Optimal Prompt Engineering

2024-07-12 · Derek Austin, Elliott Chartock

Prompt engineering for large language models (LLMs) is often a manual time-intensive process that involves generating, evaluating, and refining prompts iteratively to ensure high-quality outputs. While there has been wor…

Prompt Engineering