paper-with-me

Papers

Racial categories in machine learning

2018-11-28 · Sebastian Benthall, Bruce D. Haynes

Controversies around race and machine learning have sparked debate among computer scientists over how to design machine learning systems that guarantee fairness. These debates rarely engage with how racial identity is embedded in our social experience, making for sociological and psychological complexity. This complexity challenges the paradigm of considering fairness to be a formal property of supervised learning with respect to protected personal attributes. Racial identity is not simply a personal subjective quality. For people labeled "Black" it is an ascribed political category that has consequences for social differentiation embedded in systemic patterns of social inequality achieved through both social and spatial segregation. In the United States, racial classification can best be understood as a system of inherently unequal status categories that places whites as the most privileged category while signifying the Negro/black category as stigmatized. Social stigma is reinforced through the unequal distribution of societal rewards and goods along racial lines that is reinforced by state, corporate, and civic institutions and practices. This creates a dilemma for society and designers: be blind to racial group disparities and thereby reify racialized social inequality by no longer measuring systemic inequality, or be conscious of racial categories in a way that itself reifies race. We propose a third option. By preceding group fairness interventions with unsupervised learning to dynamically detect patterns of segregation, machine learning systems can mitigate the root cause of social disparities, social segregation and stratification, without further anchoring status categories of disadvantage.

📄 PDF Abstract BibTeX arXiv:1811.11668

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine LearningFairness

Similar Papers 제목 키워드 기반

Racial/Ethnic Categories in AI and Algorithmic Fairness: Why They Matter and What They Represent

2024-04-10 · Jennifer Mickel

Racial diversity has become increasingly discussed within the AI and algorithmic fairness literature, yet little attention is focused on justifying the choices of racial categories and understanding how people are racial…

Fairness

One Label, One Billion Faces: Usage and Consistency of Racial Categories in Computer Vision

2021-02-03 · Zaid Khan, Yun Fu

Computer vision is widely deployed, has highly visible, society altering applications, and documented problems with bias and representation. Datasets are critical for benchmarking progress in fair computer vision, and of…

BenchmarkingFairness

An experiment on the mechanisms of racial bias in ML-based credit scoring in Brazil

2020-11-11 · Ramon Vilarino, Renato Vicente

We dissect an experimental credit scoring model developed with real data and demonstrate - without access to protected attributes - how the use of location information introduces racial bias. We analyze the tree gradient…

BIG-bench Machine Learningcounterfactual

Does lossy image compression affect racial bias within face recognition?

2022-08-16 · Seyma Yucer, Matt Poyser, Noura Al Moubayed, Toby P. Breckon

Yes - This study investigates the impact of commonplace lossy image compression on face recognition algorithms with regard to the racial characteristics of the subject. We adopt a recently proposed racial phenotype-based…

Face RecognitionImage Compression

Rethinking Common Assumptions to Mitigate Racial Bias in Face Recognition Datasets

2021-09-07 · Matthew Gwilliam, Srinidhi Hegde, Lade Tinubu, Alex Hanson

Many existing works have made great strides towards reducing racial bias in face recognition. However, most of these methods attempt to rectify bias that manifests in models during training instead of directly addressing…

Face Recognitionvalid