paper-with-me

홈 › Papers

Locally Distributed Activation Vectors for Guided Feature Attribution

2022-10-01 · COLING 2022 10 · Housam K. B. Bashier, Mi-Young Kim, Randy Goebel

Explaining the predictions of a deep neural network (DNN) is a challenging problem. Many attempts at interpreting those predictions have focused on attribution-based methods, which assess the contributions of individual features to each model prediction. However, attribution-based explanations do not always provide faithful explanations to the target model, e.g., noisy gradients can result in unfaithful feature attribution for back-propagation methods. We present a method to learn explanations-specific representations while constructing deep network models for text classification. These representations can be used to faithfully interpret black-box predictions, i.e., highlighting the most important input features and their role in any particular prediction. We show that learning specific representations improves model interpretability across various tasks, for both qualitative and quantitative evaluations, while preserving predictive performance.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

text-classificationText Classification

Similar Papers 제목 키워드 기반

Variable Binding for Sparse Distributed Representations: Theory and Applications

2020-09-14 · E. Paxon Frady, Denis Kleyko, Friedrich T. Sommer

Symbolic reasoning and neural networks are often considered incompatible approaches. Connectionist models known as Vector Symbolic Architectures (VSAs) can potentially bridge this gap. However, classical VSAs and neural …

compressed sensing

Non-Local Feature Aggregation on Graphs via Latent Fixed Data Structures

2021-08-16 · Mostafa Rahmani, Rasoul Shafipour, Ping Li

In contrast to image/text data whose order can be used to perform non-local feature aggregation in a straightforward way using the pooling layers, graphs lack the tensor representation and mostly the element-wise max/mea…

Steering Large Language Models with Feature Guided Activation Additions

2025-01-17 · Samuel Soo, Wesley Teng, Chandrasekaran Balaganesh

Effective and reliable control over large language model (LLM) behavior is a significant challenge. While activation steering methods, which add steering vectors to a model's hidden states, are a promising approach, exis…

DecoderLanguage ModelingLanguage ModellingLarge Language Model

Locally Grouped and Scale-Guided Attention for Dense Pest Counting

2024-08-29 · Chang-Hwan Son

This study introduces a new dense pest counting problem to predict densely distributed pests captured by digital traps. Unlike traditional detection-based counting models for sparsely distributed objects, trap-based pest…

Spatio-Temporal Vector of Locally Max Pooled Features for Action Recognition in Videos

2017-07-01 · CVPR 2017 7 · Ionut Cosmin Duta, Bogdan Ionescu, Kiyoharu Aizawa, Nicu Sebe

We introduce Spatio-Temporal Vector of Locally Max Pooled Features (ST-VLMPF), a super vector-based encoding method specifically designed for local deep features encoding. The proposed method addresses an important prob…

Action RecognitionAction Recognition In VideosTemporal Action LocalizationVideo Understanding