paper-with-me

홈 › Papers

Generating Token-Level Explanations for Natural Language Inference

2019-04-24 · NAACL 2019 6 · James Thorne, Andreas Vlachos, Christos Christodoulopoulos, Arpit Mittal

The task of Natural Language Inference (NLI) is widely modeled as supervised sentence pair classification. While there has been a lot of work recently on generating explanations of the predictions of classifiers on a single piece of text, there have been no attempts to generate explanations of classifiers operating on pairs of sentences. In this paper, we show that it is possible to generate token-level explanations for NLI without the need for training data explicitly annotated for this purpose. We use a simple LSTM architecture and evaluate both LIME and Anchor explanations for this task. We compare these to a Multiple Instance Learning (MIL) method that uses thresholded attention make token-level predictions. The approach we present in this paper is a novel extension of zero-shot single-sentence tagging to sentence pairs for NLI. We conduct our experiments on the well-studied SNLI dataset that was recently augmented with manually annotation of the tokens that explain the entailment relation. We find that our white-box MIL-based method, while orders of magnitude faster, does not reach the same accuracy as the black-box methods.

📄 PDF Abstract BibTeX arXiv:1904.10717

Code (0)

등록된 구현이 없습니다.

Tasks

Multiple Instance LearningNatural Language InferenceSentenceSentence-Pair Classification

Methods 이 논문이 사용한 방법론

LIME LIME, or Local Interpretable Model-Agnostic Explanations, is an algorithm that can explain the predictions of any classifier or regressor in a faithful way, by…
Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Similar Papers 제목 키워드 기반

Controlled Generation with Prompt Insertion for Natural Language Explanations in Grammatical Error Correction

2023-09-20 · Masahiro Kaneko, Naoaki Okazaki

In Grammatical Error Correction (GEC), it is crucial to ensure the user's comprehension of a reason for correction. Existing studies present tokens, examples, and hints as to the basis for correction but do not directly …

Grammatical Error Correction

Faithfulness Serum: Mitigating the Faithfulness Gap in Textual Explanations of LLM Decisions via Attribution Guidance

2026-04-15 · Bar Alon, Itamar Zimerman, Lior Wolf arxiv

Large language models (LLMs) achieve strong performance and have revolutionized NLP, but their lack of explainability keeps them treated as black boxes, limiting their use in domains that demand transparency and trust. A…

Explanation Generation

PromptExp: Multi-granularity Prompt Explanation of Large Language Models

2024-10-16 · Ximing Dong, Shaowei Wang, Dayi Lin, Gopi Krishnan Rajbahadur 외

Large Language Models excel in tasks like natural language understanding and text generation. Prompt engineering plays a critical role in leveraging LLM effectively. However, LLMs black-box nature hinders its interpretab…

Natural Language UnderstandingPrompt EngineeringSemantic SimilaritySemantic Textual Similarity+2

Make Up Your Mind! Adversarial Generation of Inconsistent Natural Language Explanations

2019-10-07 · ACL 2020 6 · Oana-Maria Camburu, Brendan Shillingford, Pasquale Minervini, Thomas Lukasiewicz 외

To increase trust in artificial intelligence systems, a promising research direction consists of designing neural models capable of generating natural language explanations for their predictions. In this work, we show th…

Decision MakingNatural Language Inference

Towards More Faithful Natural Language Explanation Using Multi-Level Contrastive Learning in VQA

2023-12-21 · Chengen Lai, Shengli Song, Shiqi Meng, Jingyang Li 외

Natural language explanation in visual question answer (VQA-NLE) aims to explain the decision-making process of models by generating natural language sentences to increase users' trust in the black-box systems. Existing …

Contrastive LearningcounterfactualCounterfactual ExplanationDecision Making+1