paper-with-me

홈 › Papers

Model-agnostic interpretation by visualization of feature perturbations

2021-01-26 · Wilson E. Marcílio-Jr, Danilo M. Eler, Fabrício Breve

Interpretation of machine learning models has become one of the most important research topics due to the necessity of maintaining control and avoiding bias in these algorithms. Since many machine learning algorithms are published every day, there is a need for novel model-agnostic interpretation approaches that could be used to interpret a great variety of algorithms. Thus, one advantageous way to interpret machine learning models is to feed different input data to understand the changes in the prediction. Using such an approach, practitioners can define relations among data patterns and a model's decision. This work proposes a model-agnostic interpretation approach that uses visualization of feature perturbations induced by the PSO algorithm. We validate our approach on publicly available datasets, showing the capability to enhance the interpretation of different classifiers while yielding very stable results compared with state-of-the-art algorithms.

📄 PDF Abstract BibTeX arXiv:2101.10502

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine Learningmodel

Similar Papers 제목 키워드 기반

MASE: Interpretable NLP Models via Model-Agnostic Saliency Estimation

2025-12-04 · Zhou Yang, Shunyan Luo, Jiazhen Zhu, Fang Jin arxiv

Deep neural networks (DNNs) have made significant strides in Natural Language Processing (NLP), yet their interpretability remains elusive, particularly when evaluating their intricate decision-making processes. Traditio…

Rethinking interpretation: Input-agnostic saliency mapping of deep visual classifiers

2023-03-31 · Naveed Akhtar, Mohammad A. A. K. Jalwana

Saliency methods provide post-hoc model interpretation by attributing input features to the model outputs. Current methods mainly achieve this using a single input sample, thereby failing to answer input-independent inqu…

Algorithm-Agnostic Interpretations for Clustering

2022-09-21 · Christian A. Scholbeck, Henri Funk, Giuseppe Casalicchio

A clustering outcome for high-dimensional data is typically interpreted via post-processing, involving dimension reduction and subsequent visualization. This destroys the meaning of the data and obfuscates interpretation…

ClusteringDimensionality ReductionFeature Importance

topicwizard -- a Modern, Model-agnostic Framework for Topic Model Visualization and Interpretation

2025-05-19 · Márton Kardos, Kenneth C. Enevoldsen, Kristoffer Laigaard Nielbo

Topic models are statistical tools that allow their users to gain qualitative and quantitative insights into the contents of textual corpora without the need for close reading. They can be applied in a wide range of sett…

modelTopic Models

Towards More Robust Interpretation via Local Gradient Alignment

2022-11-29 · Sunghwan Joo, Seokhyeon Jeong, Juyeon Heo, Adrian Weller 외

Neural network interpretation methods, particularly feature attribution methods, are known to be fragile with respect to adversarial input perturbations. To address this, several methods for enhancing the local smoothnes…

Computational EfficiencyNetwork Interpretation