paper-with-me

Papers

The FairCeptron: A Framework for Measuring Human Perceptions of Algorithmic Fairness

2021-02-08 · Georg Ahnert, Ivan Smirnov, Florian Lemmerich, Claudia Wagner, Markus Strohmaier

Measures of algorithmic fairness often do not account for human perceptions of fairness that can substantially vary between different sociodemographics and stakeholders. The FairCeptron framework is an approach for studying perceptions of fairness in algorithmic decision making such as in ranking or classification. It supports (i) studying human perceptions of fairness and (ii) comparing these human perceptions with measures of algorithmic fairness. The framework includes fairness scenario generation, fairness perception elicitation and fairness perception analysis. We demonstrate the FairCeptron framework by applying it to a hypothetical university admission context where we collect human perceptions of fairness in the presence of minorities. An implementation of the FairCeptron framework is openly available, and it can easily be adapted to study perceptions of algorithmic fairness in other application contexts. We hope our work paves the way towards elevating the role of studies of human fairness perceptions in the process of designing algorithmic decision making systems.

📄 PDF Abstract BibTeX arXiv:2102.04119

Code (1)

cssh-rwth/fairceptron 공식 구현

Tasks

Decision MakingFairness

Similar Papers 제목 키워드 기반

Fairness Perceptions of Algorithmic Decision-Making: A Systematic Review of the Empirical Literature

2021-03-22 · Christopher Starke, Janine Baleis, Birte Keller, Frank Marcinkowski

Algorithmic decision-making (ADM) increasingly shapes people's daily lives. Given that such autonomous systems can cause severe harm to individuals and social groups, fairness concerns have arisen. A human-centric approa…

Decision MakingFairnessSystematic Literature Review

Dimensions of Diversity in Human Perceptions of Algorithmic Fairness

2020-05-02 · Nina Grgić-Hlača, Gabriel Lima, Adrian Weller, Elissa M. Redmiles

A growing number of oversight boards and regulatory bodies seek to monitor and govern algorithms that make decisions about people's lives. Prior work has explored how people believe algorithmic decisions should be made, …

Decision MakingDiversityFairness

HumT DumT: Measuring and controlling human-like language in LLMs

2025-02-18 · Myra Cheng, Sunny Yu, Dan Jurafsky

Should LLMs generate language that makes them seem human? Human-like language might improve user experience, but might also lead to deception, overreliance, and stereotyping. Assessing these potential impacts requires a …

Text Generation

Measuring algorithmic interpretability: A human-learning-based framework and the corresponding cognitive complexity score

2022-05-20 · John P. Lalor, Hong Guo

Algorithmic interpretability is necessary to build trust, ensure fairness, and track accountability. However, there is no existing formal measurement method for algorithmic interpretability. In this work, we build upon p…

Fairness

From tools to thieves: Measuring and understanding public perceptions of AI through crowdsourced metaphors

2025-01-29 · Myra Cheng, Angela Y. Lee, Kristina Rapuano, Kate Niederhoffer 외

How has the public responded to the increasing prevalence of artificial intelligence (AI)-based technologies? We investigate public perceptions of AI by collecting over 12,000 responses over 12 months from a nationally r…

Language ModelingLanguage Modelling