KernelArc: A Multi-Agent Framework for GPU Kernel Optimization

2026-08-17 · Joyjit Kundu, Ben Stoffelen, Kaili Wang, Peter Vrancx, Ludovic Denoyer arxiv

We present KernelArc, a multi-agent framework for autonomous GPU kernel optimization across heterogeneous workloads. Strategy-specialized agents run in parallel and coordinate through conclusions-only shared memory, a deterministic benchmark guard, and read-only cross-agent state with plateau-triggered drafting. We evaluate KernelArc on NVIDIA H100 and B200 GPUs using category-representative SOL-ExecBench workloads. The resulting implementations span custom BF16 GEMM, static cuBLASLt Expert-API configuration tables, fused mixture-of-experts backward, shape-gated decoder-layer fusion, native NVFP4 grouped-query attention, and paged prefill attention. In the public SOL-ExecBench leaderboard snapshot recorded on August~20, 2026, KernelArc ranked first on every representative L1, L2, Quantization, and FlashInfer task evaluated. The trajectories support the paper's central motivation: shared multi-agent search can broaden exploration and reach stronger incumbents within a fixed candidate budget, while the value of individual coordination features depends on the kernel and optimization stage.

📄 PDF Abstract BibTeX arXiv:2608.17071

Code (0)

등록된 구현이 없습니다.

KernelSkill: A Multi-Agent Framework for GPU Kernel Optimization

2026-03-10 · Qitong Sun, Jun Han, Tianlin Li, Zhe Tang 외 arxiv

Improving GPU kernel efficiency is crucial for advancing AI systems. Recent work has explored leveraging large language models (LLMs) for GPU kernel generation and optimization. However, existing LLM-based kernel optimiz…

STARK: Strategic Team of Agents for Refining Kernels

2025-10-19 · Juncheng Dong, Yang Yang, Tao Liu, Yang Wang 외 arxiv

The efficiency of GPU kernels is central to the progress of modern AI, yet optimizing them remains a difficult and labor-intensive task due to complex interactions between memory hierarchies, thread scheduling, and hardw…

Code Generation

AgentKernelArena: Generalization-Aware Benchmarking of GPU Kernel Optimization Agents

2026-05-16 · Sharareh Younesian, Wenwen Ouyang, Sina Rafati, Mehdi Rezagholizadeh 외 arxiv

GPU kernel optimization is increasingly critical for efficient deep learning systems, but writing high-performance kernels still requires substantial low-level expertise. Recent AI coding agents can iteratively read code…

daVinci-kernel: Co-Evolving Skill Selection, Summarization, and Utilization via RL for GPU Kernel Optimization

2026-06-15 · Dayuan Fu, Mohan Jiang, Tongyu Wang, Dian Yang 외 arxiv

GPU kernel optimization represents a paradigm where functional correctness is assumed and execution efficiency is the objective. We present daVinci-kernel, a reinforcement learning framework that couples skill discovery …

Reinforcement Learning

KernelBlaster: Continual Cross-Task CUDA Optimization via Memory-Augmented In-Context Reinforcement Learning

2026-02-15 · Kris Shengjun Dong, Sahil Modi, Dima Nikiforov, Sana Damani 외 arxiv

Optimizing CUDA code across multiple generations of GPU architectures is challenging, as achieving peak performance requires an extensive exploration of an increasingly complex, hardware-specific optimization space. Trad…