fairlib: A Unified Framework for Assessing and Improving Classification Fairness
This paper presents fairlib, an open-source framework for assessing and improving classification fairness. It provides a systematic framework for quickly reproducing existing baseline models, developing new methods, evaluating models with different metrics, and visualizing their results. Its modularity and extensibility enable the framework to be used for diverse types of inputs, including natural language, images, and audio. In detail, we implement 14 debiasing methods, including pre-processing, at-training-time, and post-processing approaches. The built-in metrics cover the most commonly used fairness criterion and can be further generalized and customized for fairness evaluation.
Code (2)
Tasks
ClassificationFairnessSimilar Papers 제목 키워드 기반
Intrinsic Meets Extrinsic Fairness: Assessing the Downstream Impact of Bias Mitigation in Large Language Models
Large Language Models (LLMs) exhibit socio-economic biases that can propagate into downstream tasks. While prior studies have questioned whether intrinsic bias in LLMs affects fairness at the downstream task level, this …
Data AugmentationAssessing Fairness in Classification Parity of Machine Learning Models in Healthcare
Fairness in AI and machine learning systems has become a fundamental problem in the accountability of AI systems. While the need for accountability of AI models is near ubiquitous, healthcare in particular is a challengi…
BIG-bench Machine LearningClassificationFairnessGeneral ClassificationSimFair: A Unified Framework for Fairness-Aware Multi-Label Classification
Recent years have witnessed increasing concerns towards unfair decisions made by machine learning algorithms. To improve fairness in model decisions, various fairness notions have been proposed and many fairness-aware me…
ClassificationFairnessMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONPareto Optimality in No-Harm Fairness
Common fairness definitions in machine learning focus on balancing various notions of disparity and utility. In this work we study fairness in the context of risk disparity among sub-populations. We introduce the framewo…
FairnessFairMT: Fairness for Heterogeneous Multi-Task Learning
Fairness in machine learning has been extensively studied in single-task settings, while fair multi-task learning (MTL), especially with heterogeneous tasks (classification, detection, regression) and partially missing l…
Multi-Task Learning