paper-with-me

홈 › Papers

Measuring a Texts Fairness Dimensions Using Machine Learning Based on Social Psychological Factors

2021-10-29 · Ahmed Izzidien, David Stillwell

Fairness is a principal social value that can be observed in civilisations around the world. A manifestation of this is in social agreements, often described in texts, such as contracts. Yet, despite the prevalence of such, a fairness metric for texts describing a social act remains wanting. To address this, we take a step back to consider the problem based on first principals. Instead of using rules or templates, we utilise social psychology literature to determine the principal factors that humans use when making a fairness assessment. We then attempt to digitise these using word embeddings into a multi-dimensioned sentence level fairness perceptions vector to serve as an approximation for these fairness perceptions. The method leverages a pro-social bias within word embeddings, for which we obtain an F1= 81.0. A second approach, using PCA and ML based on the said fairness approximation vector produces an F1 score of 86.2. We detail improvements that can be made in the methodology to incorporate the projection of sentence embedding on to a subspace representation of fairness.

📄 PDF Abstract BibTeX arXiv:2111.00086

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine LearningFairnessSentenceSentence EmbeddingSentence-EmbeddingWord Embeddings

Methods 이 논문이 사용한 방법론

PCA Principle Components Analysis (PCA) is an unsupervised method primary used for dimensionality reduction within machine learning. PCA is calculated via a singular value…

Similar Papers 제목 키워드 기반

50 Years of Test (Un)fairness: Lessons for Machine Learning

2018-11-25 · Ben Hutchinson, Margaret Mitchell

Quantitative definitions of what is unfair and what is fair have been introduced in multiple disciplines for well over 50 years, including in education, hiring, and machine learning. We trace how the notion of fairness h…

BIG-bench Machine LearningFairness

A Group Fairness Lens for Large Language Models

2023-12-24 · Guanqun Bi, Lei Shen, Yuqiang Xie, Yanan Cao 외

The rapid advancement of large language models has revolutionized various applications but also raised crucial concerns about their potential to perpetuate biases and unfairness when deployed in social media contexts. Ev…

AttributeFairnessText Generation

Connecting Algorithmic Fairness to Quality Dimensions in Machine Learning in Official Statistics and Survey Production

2024-02-14 · Patrick Oliver Schenk, Christoph Kern

National Statistical Organizations (NSOs) increasingly draw on Machine Learning (ML) to improve the timeliness and cost-effectiveness of their products. When introducing ML solutions, NSOs must ensure that high standards…

Fairness

Bias Beyond English: Evaluating Social Bias and Debiasing Methods in a Low-Resource Setting

2025-04-15 · Ej Zhou, Weiming Lu

Social bias in language models can potentially exacerbate social inequalities. Despite it having garnered wide attention, most research focuses on English data. In a low-resource scenario, the models often perform worse …

FairnessMultilingual NLP

Social Norm Bias: Residual Harms of Fairness-Aware Algorithms

2021-08-25 · Myra Cheng, Maria De-Arteaga, Lester Mackey, Adam Tauman Kalai

Many modern machine learning algorithms mitigate bias by enforcing fairness constraints across coarsely-defined groups related to a sensitive attribute like gender or race. However, these algorithms seldom account for wi…

AttributeDecision MakingFairness