paper-with-me

Papers

From Weights to Activations: Is Steering the Next Frontier of Adaptation?

2026-04-15 · Simon Ostermann, Daniil Gurgurov, Tanja Baeumel, Michael A. Hedderich, Sebastian Lapuschkin, Wojciech Samek, Vera Schmitt arxiv

Post-training adaptation of language models is commonly achieved through parameter updates or input-based methods such as fine-tuning, parameter-efficient adaptation, and prompting. In parallel, a growing body of work modifies internal activations at inference time to influence model behavior, an approach known as steering. Despite increasing use, steering is rarely analyzed within the same conceptual framework as established adaptation methods. In this work, we argue that steering should be regarded as a form of model adaptation. We introduce a set of functional criteria for adaptation methods and use them to compare steering approaches with classical alternatives. This analysis positions steering as a distinct adaptation paradigm based on targeted interventions in activation space, enabling local and reversible behavioral change without parameter updates. The resulting framing clarifies how steering relates to existing methods, motivating a unified taxonomy for model adaptation.

📄 PDF Abstract BibTeX arXiv:2604.14090

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

SALSA: Speech Aware LLM Adaptation via Learned Steering Activation Vectors

2026-05-30 · Yekaterina Yegorova, Argyrios Gerogiannis, Haolong Zheng, Julia Hockenmaier 외 arxiv

Speech-aware large language models often generalize poorly to out-of-domain settings. We propose SALSA (Speech-Aware LLM Adaptation via Learned Steering Activations), a lightweight adaptation method that learns layer-wis…

LoRA for Gender-Inclusive Rewriting and Activation Steering for Counter-Narrative Generation

2026-07-25 · Akhil Rajeev P, Manoj Balaji J arxiv

Gender-inclusive language generation seeks to transform biased text into inclusive alternatives while preserving semantic meaning and contextual coherence. This paper presents the IHLC system for the LT-EDI 2026 Shared T…

Steering Language Model Refusal with Sparse Autoencoders

2024-11-18 · Kyle O'Brien, David Majercak, Xavier Fernandes, Richard Edgar 외

Responsible practices for deploying language models include guiding models to recognize and refuse answering prompts that are considered unsafe, while complying with safe prompts. Achieving such behavior typically requir…

Language ModelingLanguage Modellingmodel

Subliminal Learning is Non-Semantic Distillation

2026-08-06 · Ethan Hadley, Eren Gultepe arxiv

Subliminal Learning (SL) is a surprising type of generalization displayed by modern language models. It allows the transfer of a bias or behavior from a teacher model to a student by distilling from seemingly unrelated o…

AI Steerability 360: A Toolkit for Steering Large Language Models

2026-03-08 · Erik Miehling, Karthikeyan Natesan Ramamurthy, Praveen Venkateswaran, Irene Ko 외 arxiv

The AI Steerability 360 toolkit is an extensible, open-source Python library for steering LLMs. Steering abstractions are designed around four model control surfaces: input (modification of the prompt), structural (modif…