paper-with-me

Papers

"There Is Not Enough Information": On the Effects of Explanations on Perceptions of Informational Fairness and Trustworthiness in Automated Decision-Making

2022-05-11 · Jakob Schoeffer, Niklas Kuehl, Yvette Machowski

Automated decision systems (ADS) are increasingly used for consequential decision-making. These systems often rely on sophisticated yet opaque machine learning models, which do not allow for understanding how a given decision was arrived at. In this work, we conduct a human subject study to assess people's perceptions of informational fairness (i.e., whether people think they are given adequate information on and explanation of the process and its outcomes) and trustworthiness of an underlying ADS when provided with varying types of information about the system. More specifically, we instantiate an ADS in the area of automated loan approval and generate different explanations that are commonly used in the literature. We randomize the amount of information that study participants get to see by providing certain groups of people with the same explanations as others plus additional explanations. From our quantitative analyses, we observe that different amounts of information as well as people's (self-assessed) AI literacy significantly influence the perceived informational fairness, which, in turn, positively relates to perceived trustworthiness of the ADS. A comprehensive analysis of qualitative feedback sheds light on people's desiderata for explanations, among which are (i) consistency (both with people's expectations and across different explanations), (ii) disclosure of monotonic relationships between features and outcome, and (iii) actionability of recommendations.

📄 PDF Abstract BibTeX arXiv:2205.05758

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingFairness

Similar Papers 제목 키워드 기반

Explain yourself! Effects of Explanations in Human-Robot Interaction

2022-04-09 · Jakob Ambsdorf, Alina Munir, Yiyao Wei, Klaas Degkwitz 외

Recent developments in explainable artificial intelligence promise the potential to transform human-robot interaction: Explanations of robot decisions could affect user perceptions, justify their reliability, and increas…

Explainable artificial intelligence

Explanations, Fairness, and Appropriate Reliance in Human-AI Decision-Making

2022-09-23 · Jakob Schoeffer, Maria De-Arteaga, Niklas Kuehl

In this work, we study the effects of feature-based explanations on distributive fairness of AI-assisted decisions, specifically focusing on the task of predicting occupations from short textual bios. We also investigate…

AttributeDecision MakingFairness

Play MNIST For Me! User Studies on the Effects of Post-Hoc, Example-Based Explanations & Error Rates on Debugging a Deep Learning, Black-Box Classifier

2020-09-10 · Courtney Ford, Eoin M. Kenny, Mark T. Keane

This paper reports two experiments (N=349) on the impact of post hoc explanations by example and error rates on peoples perceptions of a black box classifier. Both experiments show that when people are given case based e…

Explainable Artificial Intelligence (XAI)

Skill-based Explanations for Serendipitous Course Recommendation

2025-08-27 · Hung Chau, Run Yu, Zachary Pardos, Peter Brusilovsky arxiv

Academic choice is crucial in U.S. undergraduate education, allowing students significant freedom in course selection. However, navigating the complex academic environment is challenging due to limited information, guida…

Recommendation Systems

Appropriate Fairness Perceptions? On the Effectiveness of Explanations in Enabling People to Assess the Fairness of Automated Decision Systems

2021-08-14 · Jakob Schoeffer, Niklas Kuehl

It is often argued that one goal of explaining automated decision systems (ADS) is to facilitate positive perceptions (e.g., fairness or trustworthiness) of users towards such systems. This viewpoint, however, makes the …

Fairness