paper-with-me

Papers

Interpreting and improving deep-learning models with reality checks

2021-08-16 · Chandan Singh, Wooseok Ha, Bin Yu

Recent deep-learning models have achieved impressive predictive performance by learning complex functions of many variables, often at the cost of interpretability. This chapter covers recent work aiming to interpret models by attributing importance to features and feature groups for a single prediction. Importantly, the proposed attributions assign importance to interactions between features, in addition to features in isolation. These attributions are shown to yield insights across real-world domains, including bio-imaging, cosmology image and natural-language processing. We then show how these attributions can be used to directly improve the generalization of a neural network or to distill it into a simple model. Throughout the chapter, we emphasize the use of reality checks to scrutinize the proposed interpretation techniques.

📄 PDF Abstract BibTeX arXiv:2108.06847

Code (4)

Yu-Group/adaptive-wavelet-distillation 공식 구현 pytorch
csinva/hierarchical-dnn-interpretations 공식 구현 pytorch
csinva/transformation-importance 공식 구현 pytorch
laura-rieger/deep-explanation-penalization 공식 구현 pytorch

Tasks

Deep Learning

Similar Papers 제목 키워드 기반

Multilingual Previously Fact-Checked Claim Retrieval

2023-05-13 · Matúš Pikuliak, Ivan Srba, Robert Moro, Timo Hromadka 외

Fact-checkers are often hampered by the sheer amount of online content that needs to be fact-checked. NLP can help them by retrieving already existing fact-checks relevant to the content being investigated. This paper in…

Retrieval

Why Calibration Error is Wrong Given Model Uncertainty: Using Posterior Predictive Checks with Deep Learning

2021-12-02 · Achintya Gopal

Within the last few years, there has been a move towards using statistical models in conjunction with neural networks with the end goal of being able to better answer the question, "what do our models know?". From this t…

Can LLMs plan paths in the real world?

2024-11-26 · Wanyi Chen, Meng-Wen Su, Nafisa Mehjabin, Mary L. Cummings

As large language models (LLMs) increasingly integrate into vehicle navigation systems, understanding their path-planning capability is crucial. We tested three LLMs through six real-world path-planning scenarios in vari…

All

Perception Graph for Cognitive Attack Reasoning in Augmented Reality

2025-08-30 · Rongqian Chen, Shu Hong, Rifatul Islam, Mahdi Imani 외 arxiv

Augmented reality (AR) systems are increasingly deployed in tactical environments, but their reliance on seamless human-computer interaction makes them vulnerable to cognitive attacks that manipulate a user's perception …

Reliable Evaluation of Attribution Maps in CNNs: A Perturbation-Based Approach

2024-11-22 · Lars Nieradzik, Henrike Stephani, Janis Keuper

In this paper, we present an approach for evaluating attribution maps, which play a central role in interpreting the predictions of convolutional neural networks (CNNs). We show that the widely used insertion/deletion me…