paper-with-me

Papers

SAIF: A Sparse Autoencoder Framework for Interpreting and Steering Instruction Following of Language Models

2025-02-17 · Zirui He, Haiyan Zhao, Yiran Qiao, Fan Yang, Ali Payani, Jing Ma, Mengnan Du

The ability of large language models (LLMs) to follow instructions is crucial for their practical applications, yet the underlying mechanisms remain poorly understood. This paper presents a novel framework that leverages sparse autoencoders (SAE) to interpret how instruction following works in these models. We demonstrate how the features we identify can effectively steer model outputs to align with given instructions. Through analysis of SAE latent activations, we identify specific latents responsible for instruction following behavior. Our findings reveal that instruction following capabilities are encoded by a distinct set of instruction-relevant SAE latents. These latents both show semantic proximity to relevant instructions and demonstrate causal effects on model behavior. Our research highlights several crucial factors for achieving effective steering performance: precise feature identification, the role of final layer, and optimal instruction positioning. Additionally, we demonstrate that our methodology scales effectively across SAEs and LLMs of varying sizes.

📄 PDF Abstract BibTeX arXiv:2502.11356

Code (0)

등록된 구현이 없습니다.

Tasks

Instruction Following

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…
SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Can sparse autoencoders be used to decompose and interpret steering vectors?

2024-11-13 · Harry Mayne, Yushi Yang, Adam Mahdi

Steering vectors are a promising approach to control the behaviour of large language models. However, their underlying mechanisms remain poorly understood. While sparse autoencoders (SAEs) may offer a potential method to…

Beyond Input Activations: Identifying Influential Latents by Gradient Sparse Autoencoders

2025-05-12 · Dong Shu, Xuansheng Wu, Haiyan Zhao, Mengnan Du 외

Sparse Autoencoders (SAEs) have recently emerged as powerful tools for interpreting and steering the internal representations of large language models (LLMs). However, conventional approaches to analyzing SAEs typically …

Interpreting and Steering LLMs with Mutual Information-based Explanations on Sparse Autoencoders

2025-02-21 · Xuansheng Wu, Jiayi Yuan, Wenlin Yao, Xiaoming Zhai 외

Large language models (LLMs) excel at handling human queries, but they can occasionally generate flawed or unexpected responses. Understanding their internal states is crucial for understanding their successes, diagnosin…

Interpreting and Steering a Text-to-Speech Language Model with Sparse Autoencoders

2026-06-08 · Nikita Koriagin, Georgii Aparin, Nikita Balagansky, Daniil Gavrilov arxiv

Language models increasingly serve as the backbone of text-to-speech (TTS) systems, yet we understand little about the representations they build when text and generated speech tokens share a single residual stream. We t…

SAIF: Sparse Adversarial and Imperceptible Attack Framework

2022-12-14 · Tooba Imtiaz, Morgan Kohler, Jared Miller, Zifeng Wang 외

Adversarial attacks hamper the decision-making ability of neural networks by perturbing the input signal. The addition of calculated small distortion to images, for instance, can deceive a well-trained image classificati…

Decision Makingimage-classificationImage Classification