Explaining Interactions Between Text Spans
Reasoning over spans of tokens from different parts of the input is essential for natural language understanding (NLU) tasks such as fact-checking (FC), machine reading comprehension (MRC) or natural language inference (NLI). However, existing highlight-based explanations primarily focus on identifying individual important tokens or interactions only between adjacent tokens or tuples of tokens. Most notably, there is a lack of annotations capturing the human decision-making process w.r.t. the necessary interactions for informed decision-making in such tasks. To bridge this gap, we introduce SpanEx, a multi-annotator dataset of human span interaction explanations for two NLU tasks: NLI and FC. We then investigate the decision-making processes of multiple fine-tuned large language models in terms of the employed connections between spans in separate parts of the input and compare them to the human reasoning processes. Finally, we present a novel community detection based unsupervised method to extract such interaction explanations from a model's inner workings.
Code (1)
Tasks
Community DetectionDecision MakingExplainable Artificial Intelligence (XAI)Explanation GenerationFact CheckingMachine Reading ComprehensionNatural Language InferenceNatural Language UnderstandingReading ComprehensionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Learning Corresponded Rationales for Text Matching
The ability to predict matches between two sources of text has a number of applications including natural language inference (NLI) and question answering (QA). While flexible neural models have become effective tools in …
Natural Language InferenceQuestion AnsweringText MatchingA Unified Framework for Input Feature Attribution Analysis
Explaining the decision-making process of machine learning models is crucial for ensuring their reliability and fairness. One popular explanation form highlights key input features, such as i) tokens (e.g., Shapley Value…
Decision MakingDiagnosticFairnessPASTE: A Tagging-Free Decoding Framework Using Pointer Networks for Aspect Sentiment Triplet Extraction
Aspect Sentiment Triplet Extraction (ASTE) deals with extracting opinion triplets, consisting of an opinion target or aspect, its associated sentiment, and the corresponding opinion term/span explaining the rationale beh…
Aspect Sentiment Triplet ExtractionDecoderSentenceTripletExplaining Neural Network Predictions on Sentence Pairs via Learning Word-Group Masks
Explaining neural network models is important for increasing their trustworthiness in real-world applications. Most existing methods generate post-hoc explanations for neural network models by identifying individual feat…
Natural Language InferenceParaphrase IdentificationSentenceExplaining Generalization of AI-Generated Text Detectors Through Linguistic Analysis
AI-text detectors achieve high accuracy on in-domain benchmarks, but often struggle to generalize across different generation conditions such as unseen prompts, model families, or domains. While prior work has reported t…