paper-with-me

홈 › Papers

FITNESS: A Causal De-correlation Approach for Mitigating Bias in Machine Learning Software

2023-05-23 · Ying Xiao, Shangwen Wang, Sicen Liu, Dingyuan Xue, Xian Zhan, Yepang Liu

Software built on top of machine learning algorithms is becoming increasingly prevalent in a variety of fields, including college admissions, healthcare, insurance, and justice. The effectiveness and efficiency of these systems heavily depend on the quality of the training datasets. Biased datasets can lead to unfair and potentially harmful outcomes, particularly in such critical decision-making systems where the allocation of resources may be affected. This can exacerbate discrimination against certain groups and cause significant social disruption. To mitigate such unfairness, a series of bias-mitigating methods are proposed. Generally, these studies improve the fairness of the trained models to a certain degree but with the expense of sacrificing the model performance. In this paper, we propose FITNESS, a bias mitigation approach via de-correlating the causal effects between sensitive features (e.g., the sex) and the label. Our key idea is that by de-correlating such effects from a causality perspective, the model would avoid making predictions based on sensitive features and thus fairness could be improved. Furthermore, FITNESS leverages multi-objective optimization to achieve a better performance-fairness trade-off. To evaluate the effectiveness, we compare FITNESS with 7 state-of-the-art methods in 8 benchmark tasks by multiple metrics. Results show that FITNESS can outperform the state-of-the-art methods on bias mitigation while preserve the model's performance: it improved the model's fairness under all the scenarios while decreased the model's performance under only 26.67% of the scenarios. Additionally, FITNESS surpasses the Fairea Baseline in 96.72% cases, outperforming all methods we compared.

📄 PDF Abstract BibTeX arXiv:2305.14396

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingFairness

Similar Papers 제목 키워드 기반

Uncovering Main Causalities for Long-tailed Information Extraction

2021-09-11 · EMNLP 2021 11 · Guoshun Nan, Jiaqi Zeng, Rui Qiao, Zhijiang Guo 외

Information Extraction (IE) aims to extract structural information from unstructured texts. In practice, long-tailed distributions caused by the selection bias of a dataset, may lead to incorrect correlations, also known…

Causal InferencecounterfactualSelection bias

Detecting and Mitigating Algorithmic Bias in Binary Classification using Causal Modeling

2023-10-19 · Wendy Hui, Wai Kwong Lau

This paper proposes the use of causal modeling to detect and mitigate algorithmic bias. We provide a brief description of causal modeling and a general overview of our approach. We then use the Adult dataset, which is av…

Binary Classification

A Novel Generative Model with Causality Constraint for Mitigating Biases in Recommender Systems

2025-05-22 · Jianfeng Deng, Qingfeng Chen, Debo Cheng, Jiuyong Li 외

Accurately predicting counterfactual user feedback is essential for building effective recommender systems. However, latent confounding bias can obscure the true causal relationship between user feedback and item exposur…

counterfactualRecommendation SystemsRepresentation Learning

Mitigating Spurious Correlations with Causal Logit Perturbation

2025-05-21 · Xiaoling Zhou, Wei Ye, Rui Xie, Shikun Zhang

Deep learning has seen widespread success in various domains such as science, industry, and society. However, it is acknowledged that certain approaches suffer from non-robustness, relying on spurious correlations for pr…

counterfactualLong-tail LearningMeta-Learning

Correlation or Causation: Analyzing the Causal Structures of LLM and LRM Reasoning Process

2025-09-22 · Zhizhang FU, Guangsheng Bao, Hongbo Zhang, Chenkai Hu 외 arxiv

LLMs suffer from critical reasoning issues such as unfaithfulness, bias, and inconsistency, since they lack robust causal underpinnings and may rely on superficial correlations rather than genuine understanding. Successi…

Reinforcement Learning