paper-with-me

홈 › Papers

AVO: Agentic Variation Operators for Autonomous Evolutionary Search

2026-03-25 · Terry Chen, Zhifan Ye, Bing Xu, Zihao Ye, Timmy Liu, Ali Hassani, Tianqi Chen, Andrew Kerr, Haicheng Wu, Yang Xu, Yu-Jung Chen, Hanfeng Chen, Aditya Kane, Ronny Krashinsky, Ming-Yu Liu, Vinod Grover, Luis Ceze, Roger Bringmann, John Tran, Wei Liu, Fung Xie, Michael Lightstone, Humphrey Shi arxiv

Agentic Variation Operators (AVO) are a new family of evolutionary variation operators that replace the fixed mutation, crossover, and hand-designed heuristics of classical evolutionary search with autonomous coding agents. Rather than confining a language model to candidate generation within a prescribed pipeline, AVO instantiates variation as a self-directed agent loop that can consult the current lineage, a domain-specific knowledge base, and execution feedback to propose, repair, critique, and verify implementation edits. We evaluate AVO on attention, among the most aggressively optimized kernel targets in AI, on NVIDIA Blackwell (B200) GPUs. Over 7 days of continuous autonomous evolution on multi-head attention, AVO discovers kernels that outperform cuDNN by up to 3.5% and FlashAttention-4 by up to 10.5% across the evaluated configurations. The discovered optimizations transfer readily to grouped-query attention, requiring only 30 minutes of additional autonomous adaptation and yielding gains of up to 7.0% over cuDNN and 9.3% over FlashAttention-4. Together, these results show that agentic variation operators move beyond prior LLM-in-the-loop evolutionary pipelines by elevating the agent from candidate generator to variation operator, and can discover performance-critical micro-architectural optimizations that produce kernels surpassing state-of-the-art expert-engineered attention implementations on today's most advanced GPU hardware.

📄 PDF Abstract BibTeX arXiv:2603.24517

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

MermaidFlow: Redefining Agentic Workflow Generation via Safety-Constrained Evolutionary Programming

2025-05-29 · Chengqi Zheng, Jianda Chen, Yueming Lyu, Wen Zheng Terence Ng 외

Despite the promise of autonomous agentic reasoning, existing workflow generation methods frequently produce fragile, unexecutable plans due to unconstrained LLM-driven construction. We introduce MermaidFlow, a framework…

DiversityEfficient Exploration

Optimization Problem Solving Can Transition to Evolutionary Agentic Workflows

2025-05-07 · Wenhao Li, Bo Jin, Mingyi Hong, Changhong Lu 외

This position paper argues that optimization problem solving can transition from expert-dependent to evolutionary agentic workflows. Traditional optimization practices rely on human specialists for problem formulation, a…

NavigatePositionScheduling

Evolutionary System Prompt Learning for Reinforcement Learning in LLMs

2026-02-16 · Lunjun Zhang, Ryan Chen, Bradly C. Stadie arxiv

Building agentic systems that can autonomously self-improve from experience is a longstanding goal of AI. Large language models (LLMs) today primarily self-improve via two mechanisms: self-reflection for context updates,…

Reinforcement Learning

Structured mutation inspired by evolutionary theory enriches population performance and diversity

2023-02-01 · Stefano Tiso, Pedro Carvalho, Nuno Lourenço, Penousal Machado

Grammar-Guided Genetic Programming (GGGP) employs a variety of insights from evolutionary theory to autonomously design solutions for a given task. Recent insights from evolutionary biology can lead to further improvemen…

Diversityimage-classificationImage Classification

Evolutionary Programmer: Autonomously Creating Path Planning Programs based on Evolutionary Algorithms

2022-03-30 · Jiabin Lou, Rong Ding, Wenjun Wu

Evolutionary algorithms are wildly used in unmanned aerial vehicle path planning for their flexibility and effectiveness. Nevertheless, they are so sensitive to the change of environment that can't adapt to all scenarios…

Evolutionary Algorithms