Fairness Is Not Enough: Auditing Competence and Intersectional Bias in AI-powered Resume Screening

2025-07-11 · Kevin T Webster

The increasing use of generative AI for resume screening is predicated on the assumption that it offers an unbiased alternative to biased human decision-making. However, this belief fails to address a critical question: are these AI systems fundamentally competent at the evaluative tasks they are meant to perform? This study investigates the question of competence through a two-part audit of eight major AI platforms. Experiment 1 confirmed complex, contextual racial and gender biases, with some models penalizing candidates merely for the presence of demographic signals. Experiment 2, which evaluated core competence, provided a critical insight: some models that appeared unbiased were, in fact, incapable of performing a substantive evaluation, relying instead on superficial keyword matching. This paper introduces the "Illusion of Neutrality" to describe this phenomenon, where an apparent lack of bias is merely a symptom of a model's inability to make meaningful judgments. This study recommends that organizations and regulators adopt a dual-validation framework, auditing AI hiring tools for both demographic bias and demonstrable competence to ensure they are both equitable and effective.

📄 PDF Abstract BibTeX arXiv:2507.11548

Code (1)

kevinwebster/Illusion_of_Neutrality 공식 구현

Tasks

Fairness

Methods 이 논문이 사용한 방법론

ADOPT Please enter a description about the method here

Auditing Predictive Models for Intersectional Biases

2023-06-22 · Kate S. Boxer, Edward McFowland III, Daniel B. Neill

Predictive models that satisfy group fairness criteria in aggregate for members of a protected class, but do not guarantee subgroup fairness, could produce biased predictions for individuals at the intersection of two or…

Bias Detection Fairness

Evaluating Intersectional Fairness across Clinical Machine Learning Use Cases using Fairlogue and the All of Us Research Program

2026-04-07 · Nick Souligne, Vignesh Subbian arxiv

Intersectional biases in healthcare data can produce compound disparities in clinical machine learning models, yet most fairness evaluations assess demographic attributes independently. FairLogue, a toolkit for intersect…

Auditing and Achieving Intersectional Fairness in Classification Problems

2019-11-04 · Giulio Morina, Viktoriia Oliinyk, Julian Waton, Ines Marusic 외

Machine learning algorithms are extensively used to make increasingly more consequential decisions about people, so achieving optimal predictive performance can no longer be the only focus. A particularly important consi…

Attribute BIG-bench Machine Learning Classification Fairness+1

Intersectional Fairness in Large Language Models

2026-04-22 · Chaima Boufaied, Ronnie De Souza Santos, Ann Barcomb arxiv

Large Language Models (LLMs) are increasingly deployed in socially sensitive settings, raising concerns about fairness and biases, particularly across intersectional demographic attributes. In this paper, we systematical…

When LLMs Imagine People: A Human-Centered Persona Brainstorm Audit for Bias and Fairness in Creative Applications

2026-01-19 · Hongliu Cao, Eoin Thomas, Rodrigo Acuna Agost arxiv

Large Language Models (LLMs) used in creative workflows can reinforce stereotypes and perpetuate inequities, making fairness auditing essential. Existing methods rely on constrained tasks and fixed benchmarks, leaving op…

Bias Detection