Algorithm-Agnostic Interpretations for Clustering
A clustering outcome for high-dimensional data is typically interpreted via post-processing, involving dimension reduction and subsequent visualization. This destroys the meaning of the data and obfuscates interpretations. We propose algorithm-agnostic interpretation methods to explain clustering outcomes in reduced dimensions while preserving the integrity of the data. The permutation feature importance for clustering represents a general framework based on shuffling feature values and measuring changes in cluster assignments through custom score functions. The individual conditional expectation for clustering indicates observation-wise changes in the cluster assignment due to changes in the data. The partial dependence for clustering evaluates average changes in cluster assignments for the entire feature space. All methods can be used with any clustering algorithm able to reassign instances through soft or hard labels. In contrast to common post-processing methods such as principal component analysis, the introduced methods maintain the original structure of the features.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringDimensionality ReductionFeature ImportanceSimilar Papers 제목 키워드 기반
Learning Undirected Graphs in Financial Markets
We investigate the problem of learning undirected graphical models under Laplacian structural constraints from the point of view of financial market data. We show that Laplacian constraints have meaningful physical inter…
ClusteringMetaphor Interpretation Using Word Embeddings
We suggest a model for metaphor interpretation using word embeddings trained over a relatively large corpus. Our system handles nominal metaphors, like "time is money". It generates a ranked list of potential interpretat…
ClusteringWord EmbeddingsTransfer operators on graphs: Spectral clustering and beyond
Graphs and networks play an important role in modeling and analyzing complex interconnected systems such as transportation networks, integrated circuits, power grids, citation graphs, and biological and artificial neural…
ClusteringGraph Clustering$k$-Graph: A Graph Embedding for Interpretable Time Series Clustering
Time series clustering poses a significant challenge with diverse applications across domains. A prominent drawback of existing solutions lies in their limited interpretability, often confined to presenting users with ce…
ClusteringGraph EmbeddingTime SeriesTime Series ClusteringA Comparative Study of Faithfulness Metrics for Model Interpretability Methods
Interpretable methods to reveal the internal reasoning processes behind machine learning models have attracted increasing attention in recent years. To quantify the extent to which the identified interpretations truly re…
Decision Making