paper-with-me

Papers

Explaining Neural Network Predictions on Sentence Pairs via Learning Word-Group Masks

2021-04-09 · NAACL 2021 4 · Hanjie Chen, Song Feng, Jatin Ganhotra, Hui Wan, Chulaka Gunasekara, Sachindra Joshi, Yangfeng Ji

Explaining neural network models is important for increasing their trustworthiness in real-world applications. Most existing methods generate post-hoc explanations for neural network models by identifying individual feature attributions or detecting interactions between adjacent features. However, for models with text pairs as inputs (e.g., paraphrase identification), existing methods are not sufficient to capture feature interactions between two texts and their simple extension of computing all word-pair interactions between two texts is computationally inefficient. In this work, we propose the Group Mask (GMASK) method to implicitly detect word correlations by grouping correlated words from the input text pair together and measure their contribution to the corresponding NLP tasks as a whole. The proposed method is evaluated with two different model architectures (decomposable attention model and BERT) across four datasets, including natural language inference and paraphrase identification tasks. Experiments show the effectiveness of GMASK in providing faithful explanations to these models.

📄 PDF Abstract BibTeX arXiv:2104.04488

Code (1)

UVa-NLP/GMASK 공식 구현 pytorch

Tasks

Natural Language InferenceParaphrase IdentificationSentence

Similar Papers 제목 키워드 기반

A Method for Estimating the Proximity of Vector Representation Groups in Multidimensional Space. On the Example of the Paraphrase Task

2019-08-25 · Artem Artemov, Boris Alekseev

The following paper presents a method of comparing two sets of vectors. The method can be applied in all tasks, where it is necessary to measure the closeness of two objects presented as sets of vectors. It may be applic…

Semantic SimilaritySemantic Textual SimilaritySentence

Unbabel's Participation in the WMT19 Translation Quality Estimation Shared Task

2019-07-24 · WS 2019 8 · Fabio Kepler, Jonay Trénous, Marcos Treviso, Miguel Vera 외

We present the contribution of the Unbabel team to the WMT 2019 Shared Task on Quality Estimation. We participated on the word, sentence, and document-level tracks, encompassing 3 language pairs: English-German, English-…

SentenceTransfer LearningTranslation

Sequential Integrated Gradients: a simple but effective method for explaining language models

2023-05-25 · Joseph Enguehard

Several explanation methods such as Integrated Gradients (IG) can be characterised as path-based methods, as they rely on a straight line between the data and an uninformative baseline. However, when applied to language …

Sentence

Self-Explaining Structures Improve NLP Models

2020-12-03 · Zijun Sun, Chun Fan, Qinghong Han, Xiaofei Sun 외

Existing approaches to explaining deep learning models in NLP usually suffer from two major drawbacks: (1) the main model and the explaining model are decoupled: an additional probing or surrogate model is used to interp…

Natural Language InferenceParaphrase IdentificationSentiment Analysis

Explaining Face Presentation Attack Detection Using Natural Language

2021-11-08 · Hengameh Mirzaalian, Mohamed E. Hussein, Leonidas Spinoulas, Jonathan May 외

A large number of deep neural network based techniques have been developed to address the challenging problem of face presentation attack detection (PAD). Whereas such techniques' focus has been on improving PAD performa…

Face Presentation Attack DetectionLanguage ModellingSentenceText Generation