paper-with-me

홈 › Papers

TACT: Mitigating Overthinking and Overacting in Coding Agents via Activation Steering

2026-05-07 · Yuan Sui, Yulin Chen, Yibo Li, Xue Jiang, Yufei He, Yihong Dong, Xiaoxin He, Tianyu Gao, Bryan Hooi arxiv

When language model agents tackle complex software engineering tasks, they often degrade over long trajectories, which we define as *agent drift*. We focus on two recurring failure modes *overthinking* and *overacting*, i.e., where the agent repeatedly reasons over information it already has, and where it issues tool calls without integrating recent observations or acquiring new evidence. In this paper, we introduce TACT (Think-Act Calibration via activation Steering), to detect and mitigate agent drift in the residual stream before it surfaces as a behavioral failure. In specific, we label trajectory steps as overthinking, overacting, or calibrated, and find that their hidden states can separate linearly along two *drift axes*, pointing from calibrated behavior toward each failure mode (AUC $\approx$ 0.9). To mitigate agent drift, we project each step's activation onto these axes at test time and pull drifted ones back toward the calibrated region. Experiments show that TACT outperforms unsteered baselines across SWE-bench Verified, Terminal-Bench 2.0, and CLAW-Eval, lifting average resolve rate by $+5.8$ pp on Qwen3.5-27B and $+4.8$ pp on Gemma-4-26B-A4B-it while cutting steps-to-resolve by up to $26\%$. These gains frame agent drift as a steerable direction in the residual stream, and position TACT as a viable handle for reliable long-horizon agents.

📄 PDF Abstract BibTeX arXiv:2605.05980

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Overthinking Loops in Agents: A Structural Risk via MCP Tools

2026-02-16 · Yohan Lee, Jisoo Jang, Seoyeon Choi, Sangyeop Kim 외 arxiv

Tool-using LLM agents increasingly coordinate real workloads by selecting and chaining third-party tools based on text-visible metadata such as tool names, descriptions, and return messages. We show that this convenience…

The Danger of Overthinking: Examining the Reasoning-Action Dilemma in Agentic Tasks

2025-02-12 · Alejandro Cuadron, Dacheng Li, Wenjie Ma, Xingyao Wang 외

Large Reasoning Models (LRMs) represent a breakthrough in AI problem-solving capabilities, but their effectiveness in interactive environments can be limited. This paper introduces and analyzes overthinking in LRMs. A ph…

Shallow-Deep Networks: Understanding and Mitigating Network Overthinking

2018-10-16 · Yigitcan Kaya, Sanghyun Hong, Tudor Dumitras

We characterize a prevalent weakness of deep neural networks (DNNs)---overthinking---which occurs when a DNN can reach correct predictions before its final layer. Overthinking is computationally wasteful, and it can also…

image-classificationImage ClassificationPrediction

THOUGHTTERMINATOR: Benchmarking, Calibrating, and Mitigating Overthinking in Reasoning Models

2025-04-17 · Xiao Pu, Michael Saxon, Wenyue Hua, William Yang Wang

Reasoning models have demonstrated impressive performance on difficult tasks that traditional language models struggle at. However, many are plagued with the problem of overthinking--generating large amounts of unnecessa…

BenchmarkingMath

Missing Premise exacerbates Overthinking: Are Reasoning Models losing Critical Thinking Skill?

2025-04-09 · Chenrui Fan, Ming Li, Lichao Sun, Tianyi Zhou

We find that the response length of reasoning LLMs, whether trained by reinforcement learning or supervised learning, drastically increases for ill-posed questions with missing premises (MiP), ending up with redundant an…