paper-with-me

Papers

Use Perturbations when Learning from Explanations

2023-03-11 · NeurIPS 2023 11 · Juyeon Heo, Vihari Piratla, Matthew Wicker, Adrian Weller

Machine learning from explanations (MLX) is an approach to learning that uses human-provided explanations of relevant or irrelevant features for each input to ensure that model predictions are right for the right reasons. Existing MLX approaches rely on local model interpretation methods and require strong model smoothing to align model and human explanations, leading to sub-optimal performance. We recast MLX as a robustness problem, where human explanations specify a lower dimensional manifold from which perturbations can be drawn, and show both theoretically and empirically how this approach alleviates the need for strong model smoothing. We consider various approaches to achieving robustness, leading to improved performance over prior MLX methods. Finally, we show how to combine robustness with an earlier MLX method, yielding state-of-the-art results on both synthetic and real-world benchmarks.

📄 PDF Abstract BibTeX arXiv:2303.06419

Code (1)

vihari/robust_mlx 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

Factor Graph-based Interpretable Neural Networks

2025-02-20 · Yicong Li, Kuanjiu Zhou, Shuo Yu, Qiang Zhang 외

Comprehensible neural network explanations are foundations for a better understanding of decisions, especially when the input data are infused with malicious perturbations. Existing solutions generally mitigate the impac…

Investigating the Impact of Model Instability on Explanations and Uncertainty

2024-02-20 · Sara Vera Marjanović, Isabelle Augenstein, Christina Lioma

Explainable AI methods facilitate the understanding of model behaviour, yet, small, imperceptible perturbations to inputs can vastly distort explanations. As these explanations are typically evaluated holistically, befor…

Do LLM Self-Explanations Help Users Predict Model Behavior? Evaluating Counterfactual Simulatability with Pragmatic Perturbations

2026-01-07 · Pingjun Hong, Benjamin Roth arxiv

Large Language Models (LLMs) can produce verbalized self-explanations, yet prior studies suggest that such rationales may not reliably reflect the model's true decision process. We ask whether these explanations neverthe…

CREDENCE: Counterfactual Explanations for Document Ranking

2023-02-10 · Joel Rorseth, Parke Godfrey, Lukasz Golab, Mehdi Kargar 외

Towards better explainability in the field of information retrieval, we present CREDENCE, an interactive tool capable of generating counterfactual explanations for document rankers. Embracing the unique properties of the…

counterfactualDocument RankingInformation RetrievalRetrieval

Identifying the Source of Vulnerability in Explanation Discrepancy: A Case Study in Neural Text Classification

2022-12-10 · Ruixuan Tang, Hanjie Chen, Yangfeng Ji

Some recent works observed the instability of post-hoc explanations when input side perturbations are applied to the model. This raises the interest and concern in the stability of post-hoc explanations. However, the rem…

text-classificationText Classification