paper-with-me

Papers

Interpreting CFD Surrogates through Sparse Autoencoders

2025-07-21 · Yeping Hu, Shusen Liu arxiv

Learning-based surrogate models have become a practical alternative to high-fidelity CFD solvers, but their latent representations remain opaque and hinder adoption in safety-critical or regulation-bound settings. This work introduces a posthoc interpretability framework for graph-based surrogate models used in computational fluid dynamics (CFD) by leveraging sparse autoencoders (SAEs). By obtaining an overcomplete basis in the node embedding space of a pretrained surrogate, the method extracts a dictionary of interpretable latent features. The approach enables the identification of monosemantic concepts aligned with physical phenomena such as vorticity or flow structures, offering a model-agnostic pathway to enhance explainability and trustworthiness in CFD applications.

📄 PDF Abstract BibTeX arXiv:2507.16069

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Toward Identifiable Sparse Autoencoders

2026-05-29 · Walter Nelson, Theofanis Karaletsos, Francesco Locatello arxiv

Recently, sparse autoencoders (SAEs) have emerged as an attractive tool for interpreting and interacting with representations in practical neural networks. While it is common empirical folklore, we also show theoreticall…

Interpreting and Steering a Text-to-Speech Language Model with Sparse Autoencoders

2026-06-08 · Nikita Koriagin, Georgii Aparin, Nikita Balagansky, Daniil Gavrilov arxiv

Language models increasingly serve as the backbone of text-to-speech (TTS) systems, yet we understand little about the representations they build when text and generated speech tokens share a single residual stream. We t…

Interpreting Large Text-to-Image Diffusion Models with Dictionary Learning

2025-05-30 · Stepan Shabalin, Ayush Panda, Dmitrii Kharlapenko, Abdur Raheem Ali 외

Sparse autoencoders are a promising new approach for decomposing language model activations for interpretation and control. They have been applied successfully to vision transformer image encoders and to small-scale diff…

Dictionary LearningImage GenerationLanguage ModelingLanguage Modelling

BatchTopK Sparse Autoencoders

2024-12-09 · Bart Bussmann, Patrick Leask, Neel Nanda

Sparse autoencoders (SAEs) have emerged as a powerful tool for interpreting language model activations by decomposing them into sparse, interpretable features. A popular approach is the TopK SAE, that uses a fixed number…

Language ModelingLanguage Modelling

Beyond Input Activations: Identifying Influential Latents by Gradient Sparse Autoencoders

2025-05-12 · Dong Shu, Xuansheng Wu, Haiyan Zhao, Mengnan Du 외

Sparse Autoencoders (SAEs) have recently emerged as powerful tools for interpreting and steering the internal representations of large language models (LLMs). However, conventional approaches to analyzing SAEs typically …