paper-with-me

홈 › Papers

Emergent Bias and Fairness in Multi-Agent Decision Systems

2025-12-18 · Maeve Madigan, Parameswaran Kamalaruban, Glenn Moynihan, Tom Kempton, David Sutton, Stuart Burrell arxiv

Multi-agent systems have demonstrated the ability to improve performance on a variety of predictive tasks by leveraging collaborative decision making. However, the lack of effective evaluation methodologies has made it difficult to estimate the risk of bias, making deployment of such systems unsafe in high stakes domains such as consumer finance, where biased decisions can translate directly into regulatory breaches and financial loss. To address this challenge, we need to develop fairness evaluation methodologies for multi-agent predictive systems and measure the fairness characteristics of these systems in the financial tabular domain. Examining fairness metrics using large-scale simulations across diverse multi-agent configurations, with varying communication and collaboration mechanisms, we reveal patterns of emergent bias in financial decision-making that cannot be traced to individual agent components, indicating that multi-agent systems may exhibit genuinely collective behaviors. Our findings highlight that fairness risks in financial multi-agent systems represent a significant component of model risk, with tangible impacts on tasks such as credit scoring and income estimation. We advocate that multi-agent decision systems must be evaluated as holistic entities rather than through reductionist analyses of their constituent components.

📄 PDF Abstract BibTeX arXiv:2512.16433

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Making

Similar Papers 제목 키워드 기반

Fairness in Agentic AI: A Unified Framework for Ethical and Equitable Multi-Agent System

2025-02-11 · Rajesh Ranjan, Shailja Gupta, Surya Narayan Singh

Ensuring fairness in decentralized multi-agent systems presents significant challenges due to emergent biases, systemic inefficiencies, and conflicting agent incentives. This paper provides a comprehensive survey of fair…

Decision MakingEthicsFairness

Beyond Arrow's Impossibility: Fairness as an Emergent Property of Multi-Agent Collaboration

2026-04-15 · Sayan Kumar Chaki, Antoine Gourru, Julien Velcin arxiv

Fairness in language models is typically studied as a property of a single, centrally optimized model. As large language models become increasingly agentic, we propose that fairness emerges through interaction and exchan…

A Broader View on Bias in Automated Decision-Making: Reflecting on Epistemology and Dynamics

2018-07-02 · Roel Dobbe, Sarah Dean, Thomas Gilbert, Nitin Kohli

Machine learning (ML) is increasingly deployed in real world contexts, supplying actionable insights and forming the basis of automated decision-making systems. While issues resulting from biases pre-existing in training…

BIG-bench Machine LearningDecision MakingFairnessPosition

Examining Agents' Bias Amplification versus Suppression in Multi-Agent Systems

2026-05-27 · Zejian Eric Wu, Zhongyi Jiang, Yuan Zhuang, Paul Jen-Hwa Hu arxiv

Multi-agent systems are increasingly deployed to support various tasks where agents interact to achieve individual and collective objectives. Although these systems can enhance task performance and decision-making, fairn…

Risk Preferences of Learning Algorithms

2022-05-10 · Andreas Haupt, Aroon Narayanan

Agents' learning from feedback shapes economic outcomes, and many economic decision-makers today employ learning algorithms to make consequential choices. This note shows that a widely used learning algorithm, $\varepsil…

FairnessRecommendation Systems