paper-with-me

홈 › Papers

Helpful, Misleading or Confusing: How Humans Perceive Fundamental Building Blocks of Artificial Intelligence Explanations

2023-03-02 · Edward Small, Yueqing Xuan, Danula Hettiachchi, Kacper Sokol

Explainable artificial intelligence techniques are developed at breakneck speed, but suitable evaluation approaches lag behind. With explainers becoming increasingly complex and a lack of consensus on how to assess their utility, it is challenging to judge the benefit and effectiveness of different explanations. To address this gap, we take a step back from sophisticated predictive algorithms and instead look into explainability of simple decision-making models. In this setting, we aim to assess how people perceive comprehensibility of their different representations such as mathematical formulation, graphical representation and textual summarisation (of varying complexity and scope). This allows us to capture how diverse stakeholders -- engineers, researchers, consumers, regulators and the like -- judge intelligibility of fundamental concepts that more elaborate artificial intelligence explanations are built from. This position paper charts our approach to establishing appropriate evaluation methodology as well as a conceptual and practical framework to facilitate setting up and executing relevant user studies.

📄 PDF Abstract BibTeX arXiv:2303.00934

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingExplainable artificial intelligence

Similar Papers 제목 키워드 기반

Helpfulness and Fairness of Task-Oriented Dialogue Systems

2022-05-25 · Jiao Sun, Yu Hou, Jiin Kim, Nanyun Peng

Goal-oriented dialogue systems aim to help users achieve certain goals. Therefore, how humans perceive their helpfulness is important. However, neither the human-perceived helpfulness of goal-oriented dialogue systems no…

FairnessGoal-Oriented Dialogue SystemsTask-Oriented Dialogue Systems

SirenLess: reveal the intention behind news

2020-01-08 · Xumeng Chen, Leo Yu-Ho Lo, Huamin Qu

News articles tend to be increasingly misleading nowadays, preventing readers from making subjective judgments towards certain events. While some machine learning approaches have been proposed to detect misleading news, …

ArticlesDecision Making

LLM-Generated Black-box Explanations Can Be Adversarially Helpful

2024-05-10 · Rohan Ajwani, Shashidhar Reddy Javaji, Frank Rudzicz, Zining Zhu

Large Language Models (LLMs) are becoming vital tools that help us solve and understand complex problems by acting as digital assistants. LLMs can generate convincing explanations, even when only given the inputs and out…

Navigate

Confusing Image Quality Assessment: Towards Better Augmented Reality Experience

2022-04-11 · Huiyu Duan, Xiongkuo Min, Yucheng Zhu, Guangtao Zhai 외

With the development of multimedia technology, Augmented Reality (AR) has become a promising next-generation mobile platform. The primary value of AR is to promote the fusion of digital contents and real-world environmen…

Image Quality Assessment

How smart does your profile image look? Estimating intelligence from social network profile images

2016-06-29 · Xingjie Wei, David Stillwell

Profile images on social networks are users' opportunity to present themselves and to affect how others judge them. We examine what Facebook images say about users' perceived and measured intelligence. 1,122 Facebook use…