SLISEMAP: Supervised dimensionality reduction through local explanations
Existing methods for explaining black box learning models often focus on building local explanations of model behaviour for a particular data item. It is possible to create global explanations for all data items, but these explanations generally have low fidelity for complex black box models. We propose a new supervised manifold visualisation method, SLISEMAP, that simultaneously finds local explanations for all data items and builds a (typically) two-dimensional global visualisation of the black box model such that data items with similar local explanations are projected nearby. We provide a mathematical derivation of our problem and an open source implementation implemented using the GPU-optimised PyTorch library. We compare SLISEMAP to multiple popular dimensionality reduction methods and find that SLISEMAP is able to utilise labelled data to create embeddings with consistent local white box models. We also compare SLISEMAP to other model-agnostic local explanation methods and show that SLISEMAP provides comparable explanations and that the visualisations can give a broader understanding of black box regression and classification models.
Code (1)
Tasks
ClassificationDimensionality ReductionExplainable ModelsGPUSupervised dimensionality reductionSimilar Papers 제목 키워드 기반
Using Slisemap to interpret physical data
Manifold visualisation techniques are commonly used to visualise high-dimensional datasets in physical sciences. In this paper we apply a recently introduced manifold visualisation method, called Slise, on datasets from …
Explainable artificial intelligenceExplainReduce: Summarising local explanations via proxies
Most commonly used non-linear machine learning methods are closed-box models, uninterpretable to humans. The field of explainable artificial intelligence (XAI) aims to develop tools to examine the inner workings of these…
Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)Dimensionality Reduction Ensembles
Ensemble learning has had many successes in supervised learning, but it has been rare in unsupervised learning and dimensionality reduction. This study explores dimensionality reduction ensembles, using principal compone…
Dimensionality ReductionDistributed ComputingEnsemble LearningSupervised Discriminative Sparse PCA with Adaptive Neighbors for Dimensionality Reduction
Dimensionality reduction is an important operation in information visualization, feature extraction, clustering, regression, and classification, especially for processing noisy high dimensional data. However, most existi…
ClusteringDimensionality ReductionGeneral ClassificationSupervised dimensionality reductionSupervised Exponential Family Principal Component Analysis via Convex Optimization
Recently, supervised dimensionality reduction has been gaining attention, owing to the realization that data labels are often available and strongly suggest important underlying structures in the data. In this paper, we …
Dimensionality Reductionglobal-optimizationSupervised dimensionality reduction