paper-with-me

Papers

A Bandit-Based Algorithm for Fairness-Aware Hyperparameter Optimization

2020-10-07 · André F. Cruz, Pedro Saleiro, Catarina Belém, Carlos Soares, Pedro Bizarro

Considerable research effort has been guided towards algorithmic fairness but there is still no major breakthrough. In practice, an exhaustive search over all possible techniques and hyperparameters is needed to find optimal fairness-accuracy trade-offs. Hence, coupled with the lack of tools for ML practitioners, real-world adoption of bias reduction methods is still scarce. To address this, we present Fairband, a bandit-based fairness-aware hyperparameter optimization (HO) algorithm. Fairband is conceptually simple, resource-efficient, easy to implement, and agnostic to both the objective metrics, model types and the hyperparameter space being explored. Moreover, by introducing fairness notions into HO, we enable seamless and efficient integration of fairness objectives into real-world ML pipelines. We compare Fairband with popular HO methods on four real-world decision-making datasets. We show that Fairband can efficiently navigate the fairness-accuracy trade-off through hyperparameter optimization. Furthermore, without extra training cost, it consistently finds configurations attaining substantially improved fairness at a comparatively small decrease in predictive accuracy.

📄 PDF Abstract BibTeX arXiv:2010.03665

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingFairnessHyperparameter OptimizationNavigate

Similar Papers 제목 키워드 기반

Fair and Green Hyperparameter Optimization via Multi-objective and Multiple Information Source Bayesian Optimization

2022-05-18 · Antonio Candelieri, Andrea Ponti, Francesco Archetti

There is a consensus that focusing only on accuracy in searching for optimal machine learning models amplifies biases contained in the data, leading to unfair predictions and decision supports. Recently, multi-objective …

Bayesian OptimizationBIG-bench Machine LearningFairnessHyperparameter Optimization

Promoting Fairness through Hyperparameter Optimization

2021-03-23 · André F. Cruz, Pedro Saleiro, Catarina Belém, Carlos Soares 외

Considerable research effort has been guided towards algorithmic fairness but real-world adoption of bias reduction techniques is still scarce. Existing methods are either metric- or model-specific, require access to sen…

FairnessFraud DetectionHyperparameter Optimization

Contextual bandits with concave rewards, and an application to fair ranking

2022-10-18 · Virginie Do, Elvis Dohmatob, Matteo Pirotta, Alessandro Lazaric 외

We consider Contextual Bandits with Concave Rewards (CBCR), a multi-objective bandit problem where the desired trade-off between the rewards is defined by a known concave objective function, and the reward vector depends…

FairnessMulti-Armed Bandits

Efficient Automatic CASH via Rising Bandits

2020-12-08 · Yang Li, Jiawei Jiang, Jinyang Gao, Yingxia Shao 외

The Combined Algorithm Selection and Hyperparameter optimization (CASH) is one of the most fundamental problems in Automatic Machine Learning (AutoML). The existing Bayesian optimization (BO) based solutions turn the CAS…

AutoMLBayesian OptimizationBIG-bench Machine LearningHyperparameter Optimization+1

HyperArm Bandit Optimization: A Novel approach to Hyperparameter Optimization and an Analysis of Bandit Algorithms in Stochastic and Adversarial Settings

2025-03-13 · Samih Karroum, Saad Mazhar

This paper explores the application of bandit algorithms in both stochastic and adversarial settings, with a focus on theoretical analysis and practical applications. The study begins by introducing bandit problems, dist…

Bayesian OptimizationComputational EfficiencyEfficient ExplorationHyperparameter Optimization