paper-with-me

홈 › Papers

Local vs. Global interpretations for NLP

2020-10-15 · NeurIPS Workshop HAMLETS 2020 12 · Anonymous

Recently, WordsWorth scores have been proposed for calculating feature importance in the context of traditional deep learning models trained for text classification tasks. Here, we experiment with the idea behind these scores and present them as a global explanation for a trained model. Interpretability literature shows that delete one method acts as a good explanation for NLP tasks. Since WW scores act as a good proxy to delete one scores for text classification, we extend the argument and utilize them for interpretation. We provide local and global explanations for a CNN trained on the IMDB reviews dataset by comparing these scores with LIME. Similarly to LIME, the global representation is a bag of words representation. Overall, we argue that evaluating a trained neural network on single words, at all possible locations in the input text one by one, gives powerful and valid insights into the workings of these otherwise black box models. This is a work in progress and we are looking for further tests to evaluate the usefulness of our method.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Feature Importancetext-classificationText Classificationvalid

Similar Papers 제목 키워드 기반

NormLime: A New Feature Importance Metric for Explaining Deep Neural Networks

2019-09-10 · ICLR 2020 1 · Isaac Ahern, Adam Noack, Luis Guzman-Nateras, Dejing Dou 외

The problem of explaining deep learning models, and model predictions generally, has attracted intensive interest recently. Many successful approaches forgo global approximations in order to provide more faithful local i…

Feature Importance

Locally Pareto-Optimal Interpretations for Black-Box Machine Learning Models

2025-08-21 · Aniruddha Joshi, Supratik Chakraborty, S Akshay, Shetal Shah 외 arxiv

Creating meaningful interpretations for black-box machine learning models involves balancing two often conflicting objectives: accuracy and explainability. Exploring the trade-off between these objectives is essential fo…

Partial Order in Chaos: Consensus on Feature Attributions in the Rashomon Set

2021-10-26 · Gabriel Laberge, Yann Pequignot, Alexandre Mathieu, Foutse khomh 외

Post-hoc global/local feature attribution methods are progressively being employed to understand the decisions of complex machine learning models. Yet, because of limited amounts of data, it is possible to obtain a diver…

Additive modelsDiversityFeature ImportanceInterpretable Machine Learning

Temporally Coherent Interpretations for Long Videos Using Pattern Theory

2015-06-01 · CVPR 2015 6 · Fillipe Souza, Sudeep Sarkar, Anuj Srivastava, Jingyong Su

Graph-theoretical methods have successfully provided semantic and structural interpretations of images and videos. A recent paper introduced a pattern-theoretic approach that allows construction of flexible graphs for re…

A Methodology for Transparent Logic-Based Classification Using a Multi-Task Convolutional Tsetlin Machine

2025-10-02 · Mayur Kishor Shende, Ole-Christoffer Granmo, Runar Helin, Vladimir I. Zadorozhny 외 arxiv

The Tsetlin Machine (TM) is a novel machine learning paradigm that employs finite-state automata for learning and utilizes propositional logic to represent patterns. Due to its simplistic approach, TMs are inherently mor…

Image Classification