paper-with-me

Papers

Randomized Classifiers vs Human Decision-Makers: Trustworthy AI May Have to Act Randomly and Society Seems to Accept This

2021-11-15 · Gábor Erdélyi, Olivia J. Erdélyi, Vladimir Estivill-Castro

As \emph{artificial intelligence} (AI) systems are increasingly involved in decisions affecting our lives, ensuring that automated decision-making is fair and ethical has become a top priority. Intuitively, we feel that akin to human decisions, judgments of artificial agents should necessarily be grounded in some moral principles. Yet a decision-maker (whether human or artificial) can only make truly ethical (based on any ethical theory) and fair (according to any notion of fairness) decisions if full information on all the relevant factors on which the decision is based are available at the time of decision-making. This raises two problems: (1) In settings, where we rely on AI systems that are using classifiers obtained with supervised learning, some induction/generalization is present and some relevant attributes may not be present even during learning. (2) Modeling such decisions as games reveals that any -- however ethical -- pure strategy is inevitably susceptible to exploitation. Moreover, in many games, a Nash Equilibrium can only be obtained by using mixed strategies, i.e., to achieve mathematically optimal outcomes, decisions must be randomized. In this paper, we argue that in supervised learning settings, there exist random classifiers that perform at least as well as deterministic classifiers, and may hence be the optimal choice in many circumstances. We support our theoretical results with an empirical study indicating a positive societal attitude towards randomized artificial decision-makers, and discuss some policy and implementation issues related to the use of random classifiers that relate to and are relevant for current AI policy and standardization initiatives.

📄 PDF Abstract BibTeX arXiv:2111.07545

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingFairness

Similar Papers 제목 키워드 기반

Does More Advice Help? The Effects of Second Opinions in AI-Assisted Decision Making

2024-01-13 · Zhuoran Lu, Dakuo Wang, Ming Yin

AI assistance in decision-making has become popular, yet people's inappropriate reliance on AI often leads to unsatisfactory human-AI collaboration performance. In this paper, through three pre-registered, randomized hum…

Decision Making

Language Models are Alignable Decision-Makers: Dataset and Application to the Medical Triage Domain

2024-06-10 · Brian Hu, Bill Ray, Alice Leung, Amy Summerville 외

In difficult decision-making scenarios, it is common to have conflicting opinions among expert human decision-makers as there may not be a single right answer. Such decisions may be guided by different attributes that ca…

Decision MakingFairness

Position: Multi-Agent Algorithmic Care Systems Demand Contestability for Trustworthy AI

2026-03-21 · Truong Thanh Hung Nguyen, Hélène Fournier, Piper Jackson, Makoto Itoh 외 arxiv

Multi-agent systems (MAS) are increasingly used in healthcare to support complex decision-making through collaboration among specialized agents. Because these systems act as collective decision-makers, they raise challen…

Robust Bayes Treatment Choice with Partial Identification

2024-08-21 · Andrés Aradillas Fernández, José Luis Montiel Olea, Chen Qiu, Jörg Stoye 외

We study a class of binary treatment choice problems with partial identification, through the lens of robust (multiple prior) Bayesian analysis. We use a convenient set of prior distributions to derive ex-ante and ex-pos…

From Text to Trust: Empowering AI-assisted Decision Making with Adaptive LLM-powered Analysis

2025-02-17 · Zhuoyan Li, Hangxiao Zhu, Zhuoran Lu, Ziang Xiao 외

AI-assisted decision making becomes increasingly prevalent, yet individuals often fail to utilize AI-based decision aids appropriately especially when the AI explanations are absent, potentially as they do not %understan…

Decision Making