Evolutionary Context Search for Automated Skill Acquisition
Large Language Models cannot reliably acquire new knowledge post-deployment -- even when relevant text resources exist, models fail to transform them into actionable knowledge without retraining. Retrieval-Augmented Generation attempts to bridge this gap by surfacing relevant documents at inference time, yet similarity-based retrieval often fails to identify context that actually improves task performance. We introduce Evolutionary Context Search (ECS), an evolutionary method that searches context combinations using accuracy on a small development set, requiring only inference calls without weight updates. ECS moves beyond semantic similarity to discover non-obvious context pairings that significantly boost performance. Our empirical results show that ECS improves BackendBench by 27\% and $τ$-bench airline by 7\%. The evolved contexts are model-agnostic, as those evolved with Gemini-3-Flash transfer effectively to Claude Sonnet and DeepSeek. This suggests that ECS opens a path toward automated context discovery for skill acquisition -- an efficient alternative to manual prompt engineering or costly fine-tuning.
Code (0)
등록된 구현이 없습니다.
Tasks
Semantic SimilarityPrompt EngineeringSimilar Papers 제목 키워드 기반
Automated discovery of symbolic laws governing skill acquisition from naturally occurring data
Skill acquisition is a key area of research in cognitive psychology as it encompasses multiple psychological processes. The laws discovered under experimental paradigms are controversial and lack generalizability. This p…
Feature ImportanceSymbolic RegressionReal-Time Verification of Embodied Reasoning for Generative Skill Acquisition
Generative skill acquisition enables embodied agents to actively learn a scalable and evolving repertoire of control skills, crucial for the advancement of large decision models. While prior approaches often rely on supe…
Mathematical ReasoningComputational Red Teaming in a Sudoku Solving Context: Neural Network Based Skill Representation and Acquisition
In this paper we provide an insight into the skill representation, where skill representation is seen as an essential part of the skill assessment stage in the Computational Red Teaming process. Skill representation is d…
Red TeamingDesign of AI-Powered Tool for Self-Regulation Support in Programming Education
Large Language Model (LLM) tools have demonstrated their potential to deliver high-quality assistance by providing instant, personalized feedback that is crucial for effective programming education. However, many of thes…
Language ModelingLanguage ModellingLarge Language ModelMotionDisco: Motion Discovery for Extreme Humanoid Loco-Manipulation
We present MotionDisco, a framework that discovers contact-rich, long-horizon humanoid loco-manipulation motions from scratch, without relying on teleoperation or motion retargeting from human demonstrations. This is cha…
Reinforcement Learning