paper-with-me

Papers

MeEvo: Metacognitive Evolution Combined with Natural Evolution for Automatic Heuristic Design

2026-06-12 · Zishang Qiu, Xinan Chen, Rong Qu, Ruibin Bai arxiv

Large Language Models (LLMs) have advanced Automatic Heuristic Design (AHD) by enabling heuristic generation through reasoning and code synthesis. In LLM-based AHD, the LLM reasons about algorithm design and generates executable heuristic code. Existing architectures adopt two main paradigms: Natural Evolution applies crossover and mutation to this code to explore diverse strategies, but discards the reasoning traces behind the design decisions, weakening knowledge inheritance; Metacognitive Evolution retains these reasoning traces and refines them through reflection, but lacks population-level recombination, limiting exploration. These limitations reduce search efficiency, stability, and solution quality on complex problems. To address this gap, we propose MeEvo, an AHD framework that cyclically couples Natural Evolution and Metacognitive Evolution with operator balance that shifts from exploration to exploitation. Natural Evolution explores heuristic code while recording LLM-generated reasoning traces, fitness values, errors and best heuristic into a shared history; Metacognitive Evolution then reflects on this history to generate improved heuristics that feed into the next Natural Evolution cycle. This design enables population-driven exploration and reflection-driven refinement to reinforce each other. Experiments on five optimization problems show that MeEvo achieves stronger performance and lower variance than tested LLM-based AHD architectures, especially on complex constrained tasks.

📄 PDF Abstract BibTeX arXiv:2606.14202

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

MeLA: A Metacognitive LLM-Driven Architecture for Automatic Heuristic Design

2025-07-28 · Zishang Qiu, Xinan Chen, Long Chen, Ruibin Bai arxiv

This paper introduces MeLA, a Metacognitive LLM-Driven Architecture that presents a new paradigm for Automatic Heuristic Design (AHD). Traditional evolutionary methods operate directly on heuristic code; in contrast, MeL…

Fine-Tuning Language Models to Know What They Know

2026-02-02 · Sangjun Park, Elliot Meyerson, Xin Qiu, Risto Miikkulainen arxiv

Evaluating true metacognition in Large Language Models (LLMs) is difficult due to biases and heuristics. This paper presents a framework to measure and enhance LLM metacognition while controlling for these biases. A meas…

PyVRP$^+$: LLM-Driven Metacognitive Heuristic Evolution for Hybrid Genetic Search in Vehicle Routing Problems

2026-04-09 · Manuj Malik, Jianan Zhou, Shashank Reddy Chirra, Zhiguang Cao arxiv

Designing high-performing metaheuristics for NP-hard combinatorial optimization problems, such as the Vehicle Routing Problem (VRP), remains a significant challenge, often requiring extensive domain expertise and manual …

Evolution imposes an inductive bias that alters and accelerates learning dynamics

2025-05-15 · Benjamin Midler, Alejandro Pan Vazquez

The learning dynamics of biological brains and artificial neural networks are of interest to both neuroscience and machine learning. A key difference between them is that neural networks are often trained from a randomly…

Few-Shot LearningInductive Bias

Recurrent Coupled Topic Modeling over Sequential Documents

2021-06-23 · Jinjin Guo, Longbing Cao, Zhiguo Gong

The abundant sequential documents such as online archival, social media and news feeds are streamingly updated, where each chunk of documents is incorporated with smoothly evolving yet dependent topics. Such digital text…

Data AugmentationDynamic Topic Modeling