paper-with-me

홈 › Papers

Social Norm Bias: Residual Harms of Fairness-Aware Algorithms

2021-08-25 · Myra Cheng, Maria De-Arteaga, Lester Mackey, Adam Tauman Kalai

Many modern machine learning algorithms mitigate bias by enforcing fairness constraints across coarsely-defined groups related to a sensitive attribute like gender or race. However, these algorithms seldom account for within-group heterogeneity and biases that may disproportionately affect some members of a group. In this work, we characterize Social Norm Bias (SNoB), a subtle but consequential type of algorithmic discrimination that may be exhibited by machine learning models, even when these systems achieve group fairness objectives. We study this issue through the lens of gender bias in occupation classification. We quantify SNoB by measuring how an algorithm's predictions are associated with conformity to inferred gender norms. When predicting if an individual belongs to a male-dominated occupation, this framework reveals that "fair" classifiers still favor biographies written in ways that align with inferred masculine norms. We compare SNoB across algorithmic fairness methods and show that it is frequently a residual bias, and post-processing approaches do not mitigate this type of bias at all.

📄 PDF Abstract BibTeX arXiv:2108.11056

Code (0)

등록된 구현이 없습니다.

Tasks

AttributeDecision MakingFairness

Similar Papers 제목 키워드 기반

Fairness Indicators for Systematic Assessments of Visual Feature Extractors

2022-02-15 · Priya Goyal, Adriana Romero Soriano, Caner Hazirbas, Levent Sagun 외

Does everyone equally benefit from computer vision systems? Answers to this question become more and more important as computer vision systems are deployed at large scale, and can spark major concerns when they exhibit v…

Fairness

My Answer Is NOT 'Fair': Mitigating Social Bias in Vision-Language Models via Fair and Biased Residuals

2025-05-26 · Jian Lan, Yifei Fu, Udo Schlegel, Gengyuan Zhang 외

Social bias is a critical issue in large vision-language models (VLMs), where fairness- and ethics-related problems harm certain groups of people in society. It is unknown to what extent VLMs yield social bias in generat…

EthicsFairnessMultiple-choice

A Survey on Fairness in Large Language Models

2023-08-20 · Yingji Li, Mengnan Du, Rui Song, Xin Wang 외

Large Language Models (LLMs) have shown powerful performance and development prospects and are widely deployed in the real world. However, LLMs can capture social biases from unprocessed training data and propagate the b…

FairnessSurvey

POTs: Protective Optimization Technologies

2018-06-07 · Bogdan Kulynych, Rebekah Overdorf, Carmela Troncoso, Seda Gürses

Algorithmic fairness aims to address the economic, moral, social, and political impact that digital systems have on populations through solutions that can be applied by service providers. Fairness frameworks do so, in pa…

Decision MakingFairness

A Capabilities Approach to Studying Bias and Harm in Language Technologies

2024-11-06 · Hellina Hailu Nigatu, Zeerak Talat

Mainstream Natural Language Processing (NLP) research has ignored the majority of the world's languages. In moving from excluding the majority of the world's languages to blindly adopting what we make for English, we fir…

Fairness