Attribution Graphs and Causal Probing for Mechanistic Discovery and Bias Repair in Multimodal Generative Learning
We treat the internals of generative models as mechanistic objects rather than black boxes. We introduce \textbf{Attribution Graphs} (AGs), which extend GradCAM++ to circuit-level representations, and \textbf{Causal Probing}, a do-calculus intervention method for identifying causal latent structures, enabling detection and correction of spurious correlations, demographic biases, and misaligned decision circuits during training. We further propose the \textbf{Cognitive Alignment Score (CAS)}, quantifying agreement between model-internal representations and human concepts, a \textbf{saliency-first privacy mechanism} sharing only thresholded attribution nodes, a bias-aware regularizer aligning subgroup statistics, and a Reveal-to-Revise loop integrating attribution signals into parameter updates without separate fine-tuning. Evaluated on CelebA, FairFace, Jigsaw, and HateXplain, our method achieves \textbf{94.1\%} accuracy, \textbf{92.3\%} macro F1, \textbf{79.4\%} IoU-XAI, and \textbf{12.7} FID at 72--76\% adversarial robustness, while reducing subgroup disparity $Δ_{\mathrm{bias}}$ by \textbf{41\%}, demonstrating that mechanistic interpretability, fairness, and generative performance can be jointly optimized.
Code (0)
등록된 구현이 없습니다.
Tasks
Adversarial RobustnessSimilar Papers 제목 키워드 기반
Explaining the Explainer: Understanding the Inner Workings of Transformer-based Symbolic Regression Models
Following their success across many domains, transformers have also proven effective for symbolic regression (SR); however, the internal mechanisms underlying their generation of mathematical operators remain largely une…
Mechanistic Interpretability of LLM Jailbreaks via Internal Attribution Graphs
Large language models (LLMs) exhibit remarkable capabilities but remain highly vulnerable to adversarial prompts and jailbreak attacks. Existing approaches primarily analyze these failures through input-output behaviors …
Automatically Identifying Local and Global Circuits with Linear Computation Graphs
Circuit analysis of any certain model behavior is a central task in mechanistic interpretability. We introduce our circuit discovery pipeline with Sparse Autoencoders (SAEs) and a variant called Transcoders. With these t…
Causal-discovery-based root-cause analysis and its application in time-series prediction error diagnosis
Recent rapid advancements of machine learning have greatly enhanced the accuracy of prediction models, but most models remain "black boxes", making prediction error diagnosis challenging, especially with outliers. This l…
Causal DiscoveryPredictionTime SeriesTime Series PredictionSample, estimate, aggregate: A recipe for causal discovery foundation models
Causal discovery, the task of inferring causal structure from data, has the potential to uncover mechanistic insights from biological experiments, especially those involving perturbations. However, causal discovery algor…
Causal Discovery