paper-with-me

홈 › Papers

Depth-Wise Activation Steering for Honest Language Models

2025-12-08 · Gracjan Góral, Marysia Winkels, Steven Basart arxiv

Large language models sometimes assert falsehoods despite internally representing the correct answer, failures of honesty rather than accuracy, which undermines auditability and safety. Existing approaches largely optimize factual correctness or depend on retraining and brittle single-layer edits, offering limited leverage over truthful reporting. We present a training-free activation steering method that weights steering strength across network depth using a Gaussian schedule. On the MASK benchmark, which separates honesty from knowledge, we evaluate seven models spanning the LLaMA, Qwen, and Mistral families and find that Gaussian scheduling improves honesty over no-steering and single-layer baselines in six of seven models. Equal-budget ablations on LLaMA-3.1-8B-Instruct and Qwen-2.5-7B-Instruct show the Gaussian schedule outperforms random, uniform, and box-filter depth allocations, indicating that how intervention is distributed across depth materially affects outcomes beyond total strength. The method is simple, model-agnostic, requires no finetuning, and provides a low-cost control knob for eliciting truthful reporting from models' existing capabilities.

📄 PDF Abstract BibTeX arXiv:2512.07667

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Activation Steering for Aligned Open-ended Generation without Sacrificing Coherence

2026-04-09 · Niklas Herbster, Martin Zborowski, Alberto Tosato, Gauthier Gidel 외 arxiv

Alignment in LLMs is more brittle than commonly assumed: misalignment can be induced by adversarial prompts, benign fine-tuning, emergent misalignment, and goal misgeneralization. Recent evidence suggests that some misal…

Representation Tuning

2024-09-11 · Christopher M. Ackerman

Activation engineering is becoming increasingly popular as a means of online control of large language models (LLMs). In this work, we extend the idea of inference-time steering with vectors that represent a behavioral d…

Strategic Dishonesty Can Undermine AI Safety Evaluations of Frontier LLMs

2025-09-22 · Alexander Panfilov, Evgenii Kortukov, Kristina Nikolić, Matthias Bethge 외 arxiv

Large language model (LLM) developers aim for their models to be honest, helpful, and harmless. However, when faced with malicious requests, models are trained to refuse, sacrificing helpfulness. We show that frontier LL…

When Thinking LLMs Lie: Unveiling the Strategic Deception in Representations of Reasoning Models

2025-06-05 · Kai Wang, Yihao Zhang, Meng Sun

The honesty of large language models (LLMs) is a critical alignment challenge, especially as advanced systems with chain-of-thought (CoT) reasoning may strategically deceive humans. Unlike traditional honesty issues on L…

HallucinationMisinformation

But what is your honest answer? Aiding LLM-judges with honest alternatives using steering vectors

2025-05-23 · Leon Eshuijs, Archie Chaudhury, Alan McBeth, Ethan Nguyen

Recent safety evaluations of Large Language Models (LLMs) show that many models exhibit dishonest behavior, such as sycophancy. However, most honesty benchmarks focus exclusively on factual knowledge or explicitly harmfu…