Generating Token-Level Explanations for Natural Language Inference
The task of Natural Language Inference (NLI) is widely modeled as supervised sentence pair classification. While there has been a lot of work recently on generating explanations of the predictions of classifiers on a single piece of text, there have been no attempts to generate explanations of classifiers operating on pairs of sentences. In this paper, we show that it is possible to generate token-level explanations for NLI without the need for training data explicitly annotated for this purpose. We use a simple LSTM architecture and evaluate both LIME and Anchor explanations for this task. We compare these to a Multiple Instance Learning (MIL) method that uses thresholded attention make token-level predictions. The approach we present in this paper is a novel extension of zero-shot single-sentence tagging to sentence pairs for NLI. We conduct our experiments on the well-studied SNLI dataset that was recently augmented with manually annotation of the tokens that explain the entailment relation. We find that our white-box MIL-based method, while orders of magnitude faster, does not reach the same accuracy as the black-box methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Multiple Instance LearningNatural Language InferenceSentenceSentence-Pair ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Controlled Generation with Prompt Insertion for Natural Language Explanations in Grammatical Error Correction
In Grammatical Error Correction (GEC), it is crucial to ensure the user's comprehension of a reason for correction. Existing studies present tokens, examples, and hints as to the basis for correction but do not directly …
Grammatical Error CorrectionFaithfulness Serum: Mitigating the Faithfulness Gap in Textual Explanations of LLM Decisions via Attribution Guidance
Large language models (LLMs) achieve strong performance and have revolutionized NLP, but their lack of explainability keeps them treated as black boxes, limiting their use in domains that demand transparency and trust. A…
Explanation GenerationPromptExp: Multi-granularity Prompt Explanation of Large Language Models
Large Language Models excel in tasks like natural language understanding and text generation. Prompt engineering plays a critical role in leveraging LLM effectively. However, LLMs black-box nature hinders its interpretab…
Natural Language UnderstandingPrompt EngineeringSemantic SimilaritySemantic Textual Similarity+2Make Up Your Mind! Adversarial Generation of Inconsistent Natural Language Explanations
To increase trust in artificial intelligence systems, a promising research direction consists of designing neural models capable of generating natural language explanations for their predictions. In this work, we show th…
Decision MakingNatural Language InferenceTowards More Faithful Natural Language Explanation Using Multi-Level Contrastive Learning in VQA
Natural language explanation in visual question answer (VQA-NLE) aims to explain the decision-making process of models by generating natural language sentences to increase users' trust in the black-box systems. Existing …
Contrastive LearningcounterfactualCounterfactual ExplanationDecision Making+1