paper-with-me

Papers

Large Language Models for Constructing and Optimizing Machine Learning Workflows: A Survey

2024-11-11 · Yang Gu, Hengyu You, Jian Cao, Muran Yu, Haoran Fan, Shiyou Qian

Building effective machine learning (ML) workflows to address complex tasks is a primary focus of the Automatic ML (AutoML) community and a critical step toward achieving artificial general intelligence (AGI). Recently, the integration of Large Language Models (LLMs) into ML workflows has shown great potential for automating and enhancing various stages of the ML pipeline. This survey provides a comprehensive and up-to-date review of recent advancements in using LLMs to construct and optimize ML workflows, focusing on key components encompassing data and feature engineering, model selection and hyperparameter optimization, and workflow evaluation. We discuss both the advantages and limitations of LLM-driven approaches, emphasizing their capacity to streamline and enhance ML workflow modeling process through language understanding, reasoning, interaction, and generation. Finally, we highlight open challenges and propose future research directions to advance the effective application of LLMs in ML workflows.

📄 PDF Abstract BibTeX arXiv:2411.10478

Code (1)

t-harden/llm4automl 공식 구현

Tasks

AutoMLFeature EngineeringHyperparameter OptimizationModel Selection

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Toward Cross-Layer Energy Optimizations in AI Systems

2024-04-10 · Jae-Won Chung, Nishil Talati, Mosharaf Chowdhury

The "AI for Science, Energy, and Security" report from DOE outlines a significant focus on developing and optimizing artificial intelligence workflows for a foundational impact on a broad range of DOE missions. With the …

Language ModelingLanguage ModellingLarge Language Model

FlowEvo: Self-Evolving Agents through the Co-Evolution of Workflows and Executable Skills

2026-04-18 · Zeyu Ren, Ling Yue, Ran Li, Yishu Wang 외 arxiv

Large language model agents can adapt to complex tasks by constructing workflows at inference time, but procedures discovered in one episode are usually discarded after execution. Existing skill libraries provide reusabl…

Polymath: A Self-Optimizing Agent with Dynamic Hierarchical Workflow

2025-08-04 · Chia-Tung Ho, Jing Gong, Xufeng Yao, Yunsheng Bai 외 arxiv

Large language models (LLMs) excel at solving complex tasks by executing agentic workflows composed of detailed instructions and structured operations. Yet, building general-purpose agents by manually embedding foundatio…

Toward Reliable Design of LLM-Enabled Agentic Workflows: Optimizing Latency-Reliability-Cost Tradeoffs

2026-04-21 · Ya-Ting Yang, Quanyan Zhu arxiv

Modern AI systems increasingly rely on workflows composed of multiple interacting agents, some powered by large language models (LLMs) and others by conventional computational modules. This paper analyzes the fundamental…

MASSW: A New Dataset and Benchmark Tasks for AI-Assisted Scientific Workflows

2024-06-10 · Xingjian Zhang, Yutong Xie, Jin Huang, Jinge Ma 외

Scientific innovation relies on detailed workflows, which include critical steps such as analyzing literature, generating ideas, validating these ideas, interpreting results, and inspiring follow-up research. However, sc…

Navigate