paper-with-me

홈 › Papers

Interactional Fairness in LLM Multi-Agent Systems: An Evaluation Framework

2025-05-17 · Ruta Binkyte

As large language models (LLMs) are increasingly used in multi-agent systems, questions of fairness should extend beyond resource distribution and procedural design to include the fairness of how agents communicate. Drawing from organizational psychology, we introduce a novel framework for evaluating Interactional fairness encompassing Interpersonal fairness (IF) and Informational fairness (InfF) in LLM-based multi-agent systems (LLM-MAS). We extend the theoretical grounding of Interactional Fairness to non-sentient agents, reframing fairness as a socially interpretable signal rather than a subjective experience. We then adapt established tools from organizational justice research, including Colquitt's Organizational Justice Scale and the Critical Incident Technique, to measure fairness as a behavioral property of agent interaction. We validate our framework through a pilot study using controlled simulations of a resource negotiation task. We systematically manipulate tone, explanation quality, outcome inequality, and task framing (collaborative vs. competitive) to assess how IF influences agent behavior. Results show that tone and justification quality significantly affect acceptance decisions even when objective outcomes are held constant. In addition, the influence of IF vs. InfF varies with context. This work lays the foundation for fairness auditing and norm-sensitive alignment in LLM-MAS.

📄 PDF Abstract BibTeX arXiv:2505.12001

Code (0)

등록된 구현이 없습니다.

Tasks

Fairness

Similar Papers 제목 키워드 기반

Designing Fair AI for Managing Employees in Organizations: A Review, Critique, and Design Agenda

2020-02-20 · Lionel P. Robert, Casey Pierce, Liz Morris, Sangmi Kim 외

Organizations are rapidly deploying artificial intelligence (AI) systems to manage their workers. However, AI has been found at times to be unfair to workers. Unfairness toward workers has been associated with decreased …

Fairness

Towards Ethical Multi-Agent Systems of Large Language Models: A Mechanistic Interpretability Perspective

2025-12-04 · Jae Hee Lee, Anne Lauscher, Stefano V. Albrecht arxiv

Large language models (LLMs) have been widely deployed in various applications, often functioning as autonomous agents that interact with each other in multi-agent systems. While these systems have shown promise in enhan…

Emergent Bias and Fairness in Multi-Agent Decision Systems

2025-12-18 · Maeve Madigan, Parameswaran Kamalaruban, Glenn Moynihan, Tom Kempton 외 arxiv

Multi-agent systems have demonstrated the ability to improve performance on a variety of predictive tasks by leveraging collaborative decision making. However, the lack of effective evaluation methodologies has made it d…

Decision Making

Where are the Humans? A Scoping Review of Fairness in Multi-agent AI Systems

2026-04-16 · Simeon Allmendinger, Luca Deck, Lucas Mueller arxiv

Rapid advances in Generative AI are giving rise to increasingly sophisticated Multi-Agent AI (MAAI) systems. While AI fairness has been extensively studied in traditional predictive scenarios, its examination in MAAI rem…

Should agentic conversational AI change how we think about ethics? Characterising an interactional ethics centred on respect

2024-01-17 · Lize Alberts, Geoff Keeling, Amanda McCroskery

With the growing popularity of conversational agents based on large language models (LLMs), we need to ensure their behaviour is ethical and appropriate. Work in this area largely centres around the 'HHH' criteria: makin…

Ethics