The Role of Subgroup Separability in Group-Fair Medical Image Classification
We investigate performance disparities in deep classifiers. We find that the ability of classifiers to separate individuals into subgroups varies substantially across medical imaging modalities and protected characteristics; crucially, we show that this property is predictive of algorithmic bias. Through theoretical analysis and extensive empirical evaluation, we find a relationship between subgroup separability, subgroup disparities, and performance degradation when models are trained on data with systematic bias such as underdiagnosis. Our findings shed new light on the question of how models become biased, providing important insights for the development of fair medical imaging AI.
Code (1)
Tasks
image-classificationImage ClassificationMedical Image ClassificationSimilar Papers 제목 키워드 기반
Exploring the interplay of label bias with subgroup size and separability: A case study in mammographic density classification
Systematic mislabelling affecting specific subgroups (i.e., label bias) in medical imaging datasets represents an understudied issue concerning the fairness of medical AI systems. In this work, we investigated how size a…
DuetFair: Coupling Inter- and Intra-Subgroup Robustness for Fair Medical Image Segmentation
Medical image segmentation models can perform unevenly across subgroups. Most existing fairness methods focus on improving average subgroup performance, implicitly treating each subgroup as internally homogeneous. Howeve…
Medical Image SegmentationA Primer on Causal and Statistical Dataset Biases for Fair and Robust Image Analysis
Machine learning methods often fail when deployed in the real world. Worse still, they fail in high-stakes situations and across socially sensitive lines. These issues have a chilling effect on the adoption of machine le…
Representation LearningMedical DiagnosisOne Size Fits None: Rethinking Fairness in Medical AI
Machine learning (ML) models are increasingly used to support clinical decision-making. However, real-world medical datasets are often noisy, incomplete, and imbalanced, leading to performance disparities across patient …
Decision MakingFairnessPeople-Centred Medical Image Analysis via Fairness-Aware Human-AI Cooperation
Machine learning models for medical image analysis often exhibit subgroup-dependent performance, which impacts how decisions should be allocated between automated systems and human experts under limited resources. Prior …