A Fair Loss Function for Network Pruning
Model pruning can enable the deployment of neural networks in environments with resource constraints. While pruning may have a small effect on the overall performance of the model, it can exacerbate existing biases into the model such that subsets of samples see significantly degraded performance. In this paper, we introduce the performance weighted loss function, a simple modified cross-entropy loss function that can be used to limit the introduction of biases during pruning. Experiments using the CelebA, Fitzpatrick17k and CIFAR-10 datasets demonstrate that the proposed method is a simple and effective tool that can enable existing pruning methods to be used in fairness sensitive contexts. Code used to produce all experiments contained in this paper can be found at https://github.com/robbiemeyer/pw_loss_pruning.
Code (1)
Tasks
FairnessLesion ClassificationNetwork PruningSkin Lesion ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Towards Fairness-aware Adversarial Network Pruning
Network pruning aims to compress models while minimizing loss in accuracy. With the increasing focus on bias in AI systems, the bias inheriting or even magnification nature of traditional network pruning methods has …
FairnessNetwork PruningAchieving Fairness Through Channel Pruning for Dermatological Disease Diagnosis
Numerous studies have revealed that deep learning-based medical image classification models may exhibit bias towards specific demographic attributes, such as race, gender, and age. Existing bias mitigation methods often …
Fairnessimage-classificationImage ClassificationMedical Image ClassificationAchieving Fair Skin Lesion Detection through Skin Tone Normalization and Channel Pruning
Recent works have shown that deep learning based skin lesion image classification models trained on unbalanced dataset can exhibit bias toward protected demographic attributes such as race, age,and gender. Current bias m…
Image ClassificationData AugmentationFix Fairness, Don't Ruin Accuracy: Performance Aware Fairness Repair using AutoML
Machine learning (ML) is increasingly being used in critical decision-making software, but incidents have raised questions about the fairness of ML predictions. To address this issue, new tools and methods are needed to …
AutoMLDecision MakingFairnessFairDeDup: Detecting and Mitigating Vision-Language Fairness Disparities in Semantic Dataset Deduplication
Recent dataset deduplication techniques have demonstrated that content-aware dataset pruning can dramatically reduce the cost of training Vision-Language Pretrained (VLP) models without significant performance losses com…
Fairness