paper-with-me

홈 › Papers

A Gray Literature Study on Fairness Requirements in AI-enabled Software Engineering

2025-12-08 · Thanh Nguyen, Chaima Boufaied, Ronnie de Souza Santos arxiv

Today, with the growing obsession with applying Artificial Intelligence (AI), particularly Machine Learning (ML), to software across various contexts, much of the focus has been on the effectiveness of AI models, often measured through common metrics such as F1- score, while fairness receives relatively little attention. This paper presents a review of existing gray literature, examining fairness requirements in AI context, with a focus on how they are defined across various application domains, managed throughout the Software Development Life Cycle (SDLC), and the causes, as well as the corresponding consequences of their violation by AI models. Our gray literature investigation shows various definitions of fairness requirements in AI systems, commonly emphasizing non-discrimination and equal treatment across different demographic and social attributes. Fairness requirement management practices vary across the SDLC, particularly in model training and bias mitigation, fairness monitoring and evaluation, and data handling practices. Fairness requirement violations are frequently linked, but not limited, to data representation bias, algorithmic and model design bias, human judgment, and evaluation and transparency gaps. The corresponding consequences include harm in a broad sense, encompassing specific professional and societal impacts as key examples, stereotype reinforcement, data and privacy risks, and loss of trust and legitimacy in AI-supported decisions. These findings emphasize the need for consistent frameworks and practices to integrate fairness into AI software, paying as much attention to fairness as to effectiveness.

📄 PDF Abstract BibTeX arXiv:2512.07990

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Justified Evidence Collection for Argument-based AI Fairness Assurance

2025-05-12 · Alpay Sabuncuoglu, Christopher Burr, Carsten Maple

It is well recognised that ensuring fair AI systems is a complex sociotechnical challenge, which requires careful deliberation and continuous oversight across all stages of a system's lifecycle, from defining requirement…

Fairness

Fairness in Reinforcement Learning: A Survey

2024-05-11 · Anka Reuel, Devin Ma

While our understanding of fairness in machine learning has significantly progressed, our understanding of fairness in reinforcement learning (RL) remains nascent. Most of the attention has been on fairness in one-shot c…

Autonomous VehiclesFairnessreinforcement-learningReinforcement Learning+2

A Review of Fairness and A Practical Guide to Selecting Context-Appropriate Fairness Metrics in Machine Learning

2024-11-10 · Caleb J. S. Barr, Olivia Erdelyi, Paul D. Docherty, Randolph C. Grace

Recent regulatory proposals for artificial intelligence emphasize fairness requirements for machine learning models. However, precisely defining the appropriate measure of fairness is challenging due to philosophical, cu…

FairnessModel Selection

Fair Ranking with Noisy Protected Attributes

2022-11-30 · Anay Mehrotra, Nisheeth K. Vishnoi

The fair-ranking problem, which asks to rank a given set of items to maximize utility subject to group fairness constraints, has received attention in the fairness, information retrieval, and machine learning literature.…

FairnessInformation RetrievalRetrieval

Fairness risk and its privacy-enabled solution in AI-driven robotic applications

2026-01-13 · Le Liu, Bangguo Yu, Nynke Vellinga, Ming Cao arxiv

Complex decision-making by autonomous machines and algorithms could underpin the foundations of future society. Generative AI is emerging as a powerful engine for such transitions. However, we show that Generative AI-dri…

Robot NavigationDecision Making