paper-with-me

Papers

The Disparate Benefits of Deep Ensembles

2024-10-17 · Kajetan Schweighofer, Adrian Arnaiz-Rodriguez, Sepp Hochreiter, Nuria Oliver

Ensembles of Deep Neural Networks, Deep Ensembles, are widely used as a simple way to boost predictive performance. However, their impact on algorithmic fairness is not well understood yet. Algorithmic fairness investigates how a model's performance varies across different groups, typically defined by protected attributes such as age, gender, or race. In this work, we investigate the interplay between the performance gains from Deep Ensembles and fairness. Our analysis reveals that they unevenly favor different groups in what we refer to as a disparate benefits effect. We empirically investigate this effect with Deep Ensembles applied to popular facial analysis and medical imaging datasets, where protected group attributes are given and find that it occurs for multiple established group fairness metrics, including statistical parity and equal opportunity. Furthermore, we identify the per-group difference in predictive diversity of ensemble members as the potential cause of the disparate benefits effect. Finally, we evaluate different approaches to reduce unfairness due to the disparate benefits effect. Our findings show that post-processing is an effective method to mitigate this unfairness while preserving the improved performance of Deep Ensembles.

📄 PDF Abstract BibTeX arXiv:2410.13831

Code (1)

ml-jku/disparate-benefits 공식 구현 pytorch

Tasks

DiversityFairness

Methods 이 논문이 사용한 방법론

Deep Ensembles 설명 없음

Similar Papers 제목 키워드 기반

Pathologies of Predictive Diversity in Deep Ensembles

2023-02-01 · Taiga Abe, E. Kelly Buchanan, Geoff Pleiss, John P. Cunningham

Classic results establish that encouraging predictive diversity improves performance in ensembles of low-capacity models, e.g. through bagging or boosting. Here we demonstrate that these intuitions do not apply to high-c…

Diversity

On the Direction of Discrimination: An Information-Theoretic Analysis of Disparate Impact in Machine Learning

2018-01-16 · Hao Wang, Berk Ustun, Flavio P. Calmon

In the context of machine learning, disparate impact refers to a form of systematic discrimination whereby the output distribution of a model depends on the value of a sensitive attribute (e.g., race or gender). In this …

AttributeBIG-bench Machine LearningBinary Classification

Continual Learning Beyond a Single Model

2022-02-20 · Thang Doan, Seyed Iman Mirzadeh, Mehrdad Farajtabar

A growing body of research in continual learning focuses on the catastrophic forgetting problem. While many attempts have been made to alleviate this problem, the majority of the methods assume a single model in the cont…

Continual Learningmodel

Improved Robustness Against Adaptive Attacks With Ensembles and Error-Correcting Output Codes

2023-03-04 · Thomas Philippon, Christian Gagné

Neural network ensembles have been studied extensively in the context of adversarial robustness and most ensemble-based approaches remain vulnerable to adaptive attacks. In this paper, we investigate the robustness of Er…

Adversarial RobustnessDiversity

Ensembles for Uncertainty Estimation: Benefits of Prior Functions and Bootstrapping

2022-06-08 · Vikranth Dwaracherla, Zheng Wen, Ian Osband, Xiuyuan Lu 외

In machine learning, an agent needs to estimate uncertainty to efficiently explore and adapt and to make effective decisions. A common approach to uncertainty estimation maintains an ensemble of models. In recent years, …