Why is "Problems" Predictive of Positive Sentiment? A Case Study of Explaining Unintuitive Features in Sentiment Classification
Explainable AI (XAI) algorithms aim to help users understand how a machine learning model makes predictions. To this end, many approaches explain which input features are most predictive of a target label. However, such explanations can still be puzzling to users (e.g., in product reviews, the word "problems" is predictive of positive sentiment). If left unexplained, puzzling explanations can have negative impacts. Explaining unintuitive associations between an input feature and a target label is an underexplored area in XAI research. We take an initial effort in this direction using unintuitive associations learned by sentiment classifiers as a case study. We propose approaches for (1) automatically detecting associations that can appear unintuitive to users and (2) generating explanations to help users understand why an unintuitive feature is predictive. Results from a crowdsourced study (N=300) found that our proposed approaches can effectively detect and explain predictive but unintuitive features in sentiment classification.
Code (0)
등록된 구현이 없습니다.
Tasks
Sentiment AnalysisSentiment ClassificationSimilar Papers 제목 키워드 기반
Analyst Reports and Stock Performance: Evidence from the Chinese Market
This article applies natural language processing (NLP) to extract and quantify textual information to predict stock performance. Using an extensive dataset of Chinese analyst reports and employing a customized BERT deep …
Sentiment AnalysisInformation Content of Financial Youtube Channel: Case Study of 3PROTV and Korean Stock Market
We investigate the information content of 3PROTV, a south Korean financial youtube channel. In our sample we found evidence for the hypothesis that the channel have information content on stock selection, but only on neg…
Bug Destiny Prediction in Large Open-Source Software Repositories through Sentiment Analysis and BERT Topic Modeling
This study explores a novel approach to predicting key bug-related outcomes, including the time to resolution, time to fix, and ultimate status of a bug, using data from the Bugzilla Eclipse Project. Specifically, we lev…
Binary ClassificationSentiment AnalysisSentiment ClassificationExamination of Community Sentiment Dynamics due to COVID-19 Pandemic: A Case Study from A State in Australia
The outbreak of the novel Coronavirus Disease 2019 (COVID-19) has caused unprecedented impacts to people's daily life around the world. Various measures and policies such as lockdown and social-distancing are implemented…
Sentiment AnalysisBeyond Sentiment: The Manifold of Human Emotions
Sentiment analysis predicts the presence of positive or negative emotions in a text document. In this paper we consider higher dimensional extensions of the sentiment concept, which represent a richer set of human emotio…
Sentiment Analysis