Decomposition of Global Feature Importance into Direct and Associative Components (DEDACT)
Global model-agnostic feature importance measures either quantify whether features are directly used for a model's predictions (direct importance) or whether they contain prediction-relevant information (associative importance). Direct importance provides causal insight into the model's mechanism, yet it fails to expose the leakage of information from associated but not directly used variables. In contrast, associative importance exposes information leakage but does not provide causal insight into the model's mechanism. We introduce DEDACT - a framework to decompose well-established direct and associative importance measures into their respective associative and direct components. DEDACT provides insight into both the sources of prediction-relevant information in the data and the direct and indirect feature pathways by which the information enters the model. We demonstrate the method's usefulness on simulated examples.
Code (1)
Tasks
Feature ImportanceSimilar Papers 제목 키워드 기반
Unifying local and global model explanations by functional decomposition of low dimensional structures
We consider a global representation of a regression or classification function by decomposing it into the sum of main and interaction components of arbitrary order. We propose a new identification constraint that allows …
Feature ImportanceDisentangling Interactions and Dependencies in Feature Attribution
In explainable machine learning, global feature importance methods try to determine how much each individual feature contributes to predicting the target variable, resulting in one importance score for each feature. But …
Feature ImportanceGuided Graph Spectral Embedding: Application to the C. elegans Connectome
Graph spectral analysis can yield meaningful embeddings of graphs by providing insight into distributed features not directly accessible in nodal domain. Recent efforts in graph signal processing have proposed new decomp…
Directional Global Three-part Image Decomposition
We consider the task of image decomposition and we introduce a new model coined directional global three-part decomposition (DG3PD) for solving it. As key ingredients of the DG3PD model, we introduce a discrete multi-dir…
Image CompressionOptical Character RecognitionOptical Character Recognition (OCR)From Global to Local Correlation: Geometric Decomposition of Statistical Inference
Understanding feature-outcome associations in high-dimensional data remains challenging when relationships vary across subpopulations, yet standard methods assuming global associations miss context-dependent patterns, re…