paper-with-me

Papers

FairX: A comprehensive benchmarking tool for model analysis using fairness, utility, and explainability

2024-06-20 · Md Fahim Sikder, Resmi Ramachandranpillai, Daniel de Leng, Fredrik Heintz

We present FairX, an open-source Python-based benchmarking tool designed for the comprehensive analysis of models under the umbrella of fairness, utility, and eXplainability (XAI). FairX enables users to train benchmarking bias-mitigation models and evaluate their fairness using a wide array of fairness metrics, data utility metrics, and generate explanations for model predictions, all within a unified framework. Existing benchmarking tools do not have the way to evaluate synthetic data generated from fair generative models, also they do not have the support for training fair generative models either. In FairX, we add fair generative models in the collection of our fair-model library (pre-processing, in-processing, post-processing) and evaluation metrics for evaluating the quality of synthetic fair data. This version of FairX supports both tabular and image datasets. It also allows users to provide their own custom datasets. The open-source FairX benchmarking package is publicly available at \url{https://github.com/fahim-sikder/FairX}.

📄 PDF Abstract BibTeX arXiv:2406.14281

Code (1)

fahim-sikder/fairx 공식 구현 pytorch

Tasks

BenchmarkingFairness

Methods 이 논문이 사용한 방법론

Library 설명 없음

Similar Papers 제목 키워드 기반

Fairness and Privacy Guarantees in Federated Contextual Bandits

2024-02-05 · Sambhav Solanki, Shweta Jain, Sujit Gujar

This paper considers the contextual multi-armed bandit (CMAB) problem with fairness and privacy guarantees in a federated environment. We consider merit-based exposure as the desired fair outcome, which provides exposure…

FairnessFederated LearningMulti-Armed Bandits

How Biased are Your Features?: Computing Fairness Influence Functions with Global Sensitivity Analysis

2022-06-01 · Bishwamittra Ghosh, Debabrota Basu, Kuldeep S. Meel

Fairness in machine learning has attained significant focus due to the widespread application in high-stake decision-making tasks. Unregulated machine learning classifiers can exhibit bias towards certain demographic gro…

BIG-bench Machine LearningDecision MakingFairnessSensitivity

PerFairX: Is There a Balance Between Fairness and Personality in Large Language Model Recommendations?

2025-08-20 · Chandan Kumar Sah arxiv

The integration of Large Language Models (LLMs) into recommender systems has enabled zero-shot, personality-based personalization through prompt-based interactions, offering a new paradigm for user-centric recommendation…

Continual Learning

FFB: A Fair Fairness Benchmark for In-Processing Group Fairness Methods

2023-06-15 · Xiaotian Han, Jianfeng Chi, Yu Chen, Qifan Wang 외

This paper introduces the Fair Fairness Benchmark (\textsf{FFB}), a benchmarking framework for in-processing group fairness methods. Ensuring fairness in machine learning is important for ethical compliance. However, the…

BenchmarkingFairnessGPU

FairXGBoost: Fairness-aware Classification in XGBoost

2020-09-03 · Srinivasan Ravichandran, Drona Khurana, Bharath Venkatesh, Narayanan Unny Edakunni

Highly regulated domains such as finance have long favoured the use of machine learning algorithms that are scalable, transparent, robust and yield better performance. One of the most prominent examples of such an algori…

ClassificationFairnessGeneral Classification