paper-with-me

Papers

LLM-Guided Evolution: An Autonomous Model Optimization for Object Detection

2025-04-03 · Yiming Yu, Jason Zutty

In machine learning, Neural Architecture Search (NAS) requires domain knowledge of model design and a large amount of trial-and-error to achieve promising performance. Meanwhile, evolutionary algorithms have traditionally relied on fixed rules and pre-defined building blocks. The Large Language Model (LLM)-Guided Evolution (GE) framework transformed this approach by incorporating LLMs to directly modify model source code for image classification algorithms on CIFAR data and intelligently guide mutations and crossovers. A key element of LLM-GE is the "Evolution of Thought" (EoT) technique, which establishes feedback loops, allowing LLMs to refine their decisions iteratively based on how previous operations performed. In this study, we perform NAS for object detection by improving LLM-GE to modify the architecture of You Only Look Once (YOLO) models to enhance performance on the KITTI dataset. Our approach intelligently adjusts the design and settings of YOLO to find the optimal algorithms against objective such as detection accuracy and speed. We show that LLM-GE produced variants with significant performance improvements, such as an increase in Mean Average Precision from 92.5% to 94.5%. This result highlights the flexibility and effectiveness of LLM-GE on real-world challenges, offering a novel paradigm for automated machine learning that combines LLM-driven reasoning with evolutionary strategies.

📄 PDF Abstract BibTeX arXiv:2504.02280

Code (0)

등록된 구현이 없습니다.

Tasks

Evolutionary Algorithmsimage-classificationImage ClassificationLarge Language ModelModel OptimizationNeural Architecture Searchobject-detectionObject Detection

Similar Papers 제목 키워드 기반

AEGIS : Automated Co-Evolutionary Framework for Guarding Prompt Injections Schema

2025-08-27 · Ting-Chun Liu, Ching-Yu Hsu, Kuan-Yi Lee, Chi-An Fu 외 arxiv

Prompt injection attacks pose a significant challenge to the safe deployment of Large Language Models (LLMs) in real-world applications. While prompt-based detection offers a lightweight and interpretable defense strateg…

Prompt Engineering

Beyond AI as Assistants: Toward Autonomous Discovery in Cosmology

2026-05-14 · Licong Xu, Thomas Borrett arxiv

Recent advances in artificial intelligence (AI) agents are pushing AI beyond tools toward autonomous scientific discovery. We discuss two complementary agentic systems for cosmology: \texttt{CMBEvolve}, which targets tas…

Out-of-Distribution Detection

CurEvo: Curriculum-Guided Self-Evolution for Video Understanding

2026-04-29 · Guiyi Zeng, Junqing Yu, Yi-Ping Phoebe Chen, Xu Chen 외 arxiv

Recent advances in self-evolution video understanding frameworks have demonstrated the potential of autonomous learning without human annotations. However, existing methods often suffer from weakly controlled optimizatio…

Question Generation

Robust Object Detection for Autonomous Driving via Curriculum-Guided Group Relative Policy Optimization

2025-09-19 · Xu Jia arxiv

Multimodal Large Language Models (MLLMs) excel in vision-language reasoning but often struggle with structured perception tasks requiring precise localization and robustness. We propose a reinforcement learning framework…

Robust Object DetectionReinforcement LearningAutonomous Driving

Neuroevolutionary Multi-objective approaches to Trajectory Prediction in Autonomous Vehicles

2022-05-04 · Fergal Stapleton, Edgar Galván, Ganesh Sistu, Senthil Yogamani

The incentive for using Evolutionary Algorithms (EAs) for the automated optimization and training of deep neural networks (DNNs), a process referred to as neuroevolution, has gained momentum in recent years. The configur…

Autonomous VehiclesEvolutionary AlgorithmsTrajectory Prediction