paper-with-me

Papers

Attribution Graphs and Causal Probing for Mechanistic Discovery and Bias Repair in Multimodal Generative Learning

2025-10-14 · Noor Islam S. Mohammad, Uluğ Bayazıt arxiv

We treat the internals of generative models as mechanistic objects rather than black boxes. We introduce \textbf{Attribution Graphs} (AGs), which extend GradCAM++ to circuit-level representations, and \textbf{Causal Probing}, a do-calculus intervention method for identifying causal latent structures, enabling detection and correction of spurious correlations, demographic biases, and misaligned decision circuits during training. We further propose the \textbf{Cognitive Alignment Score (CAS)}, quantifying agreement between model-internal representations and human concepts, a \textbf{saliency-first privacy mechanism} sharing only thresholded attribution nodes, a bias-aware regularizer aligning subgroup statistics, and a Reveal-to-Revise loop integrating attribution signals into parameter updates without separate fine-tuning. Evaluated on CelebA, FairFace, Jigsaw, and HateXplain, our method achieves \textbf{94.1\%} accuracy, \textbf{92.3\%} macro F1, \textbf{79.4\%} IoU-XAI, and \textbf{12.7} FID at 72--76\% adversarial robustness, while reducing subgroup disparity $Δ_{\mathrm{bias}}$ by \textbf{41\%}, demonstrating that mechanistic interpretability, fairness, and generative performance can be jointly optimized.

📄 PDF Abstract BibTeX arXiv:2510.12957

Code (0)

등록된 구현이 없습니다.

Tasks

Adversarial Robustness

Similar Papers 제목 키워드 기반

Explaining the Explainer: Understanding the Inner Workings of Transformer-based Symbolic Regression Models

2026-02-03 · Arco van Breda, Erman Acar arxiv

Following their success across many domains, transformers have also proven effective for symbolic regression (SR); however, the internal mechanisms underlying their generation of mathematical operators remain largely une…

Mechanistic Interpretability of LLM Jailbreaks via Internal Attribution Graphs

2026-07-08 · Anupam Wagle, Ifrat Ikhtear Uddin, Chaowei Zhang, Longwei Wang arxiv

Large language models (LLMs) exhibit remarkable capabilities but remain highly vulnerable to adversarial prompts and jailbreak attacks. Existing approaches primarily analyze these failures through input-output behaviors …

Automatically Identifying Local and Global Circuits with Linear Computation Graphs

2024-05-22 · Xuyang Ge, Fukang Zhu, Wentao Shu, Junxuan Wang 외

Circuit analysis of any certain model behavior is a central task in mechanistic interpretability. We introduce our circuit discovery pipeline with Sparse Autoencoders (SAEs) and a variant called Transcoders. With these t…

Causal-discovery-based root-cause analysis and its application in time-series prediction error diagnosis

2024-11-11 · Hiroshi Yokoyama, Ryusei Shingaki, Kaneharu Nishino, Shohei Shimizu 외

Recent rapid advancements of machine learning have greatly enhanced the accuracy of prediction models, but most models remain "black boxes", making prediction error diagnosis challenging, especially with outliers. This l…

Causal DiscoveryPredictionTime SeriesTime Series Prediction

Sample, estimate, aggregate: A recipe for causal discovery foundation models

2024-02-02 · Menghua Wu, Yujia Bao, Regina Barzilay, Tommi Jaakkola

Causal discovery, the task of inferring causal structure from data, has the potential to uncover mechanistic insights from biological experiments, especially those involving perturbations. However, causal discovery algor…

Causal Discovery