paper-with-me

홈 › Papers

Evaluating neural network explanation methods using hybrid documents and morphological agreement

2018-01-19 · Nina Poerner, Benjamin Roth, Hinrich Schütze

The behavior of deep neural networks (DNNs) is hard to understand. This makes it necessary to explore post hoc explanation methods. We conduct the first comprehensive evaluation of explanation methods for NLP. To this end, we design two novel evaluation paradigms that cover two important classes of NLP problems: small context and large context problems. Both paradigms require no manual annotation and are therefore broadly applicable. We also introduce LIMSSE, an explanation method inspired by LIME that is designed for NLP. We show empirically that LIMSSE, LRP and DeepLIFT are the most effective explanation methods and recommend them for explaining DNNs in NLP.

📄 PDF Abstract BibTeX arXiv:1801.06422

Code (1)

ArrasL/LRP_for_LSTM 공식 구현 tf

Methods 이 논문이 사용한 방법론

LIME LIME, or Local Interpretable Model-Agnostic Explanations, is an algorithm that can explain the predictions of any classifier or regressor in a faithful way, by…

Similar Papers 제목 키워드 기반

Evaluating neural network explanation methods using hybrid documents and morphosyntactic agreement

2018-07-01 · ACL 2018 7 · Nina Poerner, Hinrich Sch{\"u}tze, Benjamin Roth

The behavior of deep neural networks (DNNs) is hard to understand. This makes it necessary to explore post hoc explanation methods. We conduct the first comprehensive evaluation of explanation methods for NLP. To this en…

Sentiment Analysis

Why Did the Robot Cross the Road? A User Study of Explanation in Human-Robot Interaction

2020-11-30 · Zachary Taschdjian

This work documents a pilot user study evaluating the effectiveness of contrastive, causal and example explanations in supporting human understanding of AI in a hypothetical commonplace human robot interaction HRI scenar…

Explainable Artificial Intelligence (XAI)

A Survey on Aspect-Based Sentiment Classification

2022-03-27 · Gianni Brauwers, Flavius Frasincar

With the constantly growing number of reviews and other sentiment-bearing texts on the Web, the demand for automatic sentiment analysis algorithms continues to expand. Aspect-based sentiment classification (ABSC) allows …

ClassificationSentiment AnalysisSentiment ClassificationSurvey

Morphological Analysis for the Maltese Language: The Challenges of a Hybrid System

2017-03-25 · WS 2017 4 · Claudia Borg, Albert Gatt

Maltese is a morphologically rich language with a hybrid morphological system which features both concatenative and non-concatenative processes. This paper analyses the impact of this hybridity on the performance of mach…

ClusteringMorphological Analysis

FinDVer: Explainable Claim Verification over Long and Hybrid-Content Financial Documents

2024-11-08 · Yilun Zhao, Yitao Long, Yuru Jiang, Chengye Wang 외

We introduce FinDVer, a comprehensive benchmark specifically designed to evaluate the explainable claim verification capabilities of LLMs in the context of understanding and analyzing long, hybrid-content financial docum…

Claim VerificationRAG