CoACT: Action-Preserving Observation Compression for Coding Agents
LLM-based coding agents solve software-engineering tasks through iterative interactions with development environments, where returned observations accumulate in the context and become a major source of inference cost. Observation compression reduces this cost by shortening observations before they are appended to the context. However, existing methods still exhibit an unsatisfactory efficiency-effectiveness trade-off, as they do not explicitly model how compression affects the agent's subsequent behavior. This paper proposes CoACT, an action-preserving observation compression method for coding agents. CoACT is built on next-action preservation (NAP), which requires a compressed observation to induce the same next action as the raw observation. By checking the agent's immediate next action, NAP provides a practical signal for whether a compression preserves the information needed for continued task solving. During training, a teacher model first generates multiple compressed candidates of each observation. CoACT then uses an action-preservation reward based on NAP to filter out candidates that would change the agent's next action, and uses a length-reduction reward to choose compact candidates as supervision for a lightweight compressor. Experiments on SWE-bench Verified with three agentic models show that CoACT reduces average total token consumption by 33.0% while maintaining task-solving effectiveness close to the uncompressed agent.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
CoAct-1: Computer-using Multi-Agent System with Coding Actions
Autonomous agents that operate computers via Graphical User Interfaces (GUIs) often struggle with efficiency and reliability on complex, long-horizon tasks. While augmenting these agents with planners can improve task de…
Muscle coactivation primes the nervous system for fast and task-dependent feedback control
Humans and other animals coactivate agonist and antagonist muscles in many motor actions. Increases in muscle coactivation are thought to leverage viscoelastic properties of skeletal muscles to provide resistance against…
Hyperspectral Variational Autoencoders for Joint Data Compression and Component Extraction
Geostationary hyperspectral satellites generate terabytes of data daily, creating critical challenges for storage, transmission, and distribution to the scientific community. We present a variational autoencoder (VAE) ap…
CoActionGraphRec: Sequential Multi-Interest Recommendations Using Co-Action Graphs
There are unique challenges to developing item recommender systems for e-commerce platforms like eBay due to sparse data and diverse user interests. While rich user-item interactions are important, eBay's data sparsity e…
Graph Neural NetworkRecommendation SystemsEcoAct: Economic Agent Determines When to Register What Action
Recent advancements have enabled Large Language Models (LLMs) to function as agents that can perform actions using external tools. This requires registering, i.e., integrating tool information into the LLM context prior …