Neither Private Nor Fair: Impact of Data Imbalance on Utility and Fairness in Differential Privacy
Deployment of deep learning in different fields and industries is growing day by day due to its performance, which relies on the availability of data and compute. Data is often crowd-sourced and contains sensitive information about its contributors, which leaks into models that are trained on it. To achieve rigorous privacy guarantees, differentially private training mechanisms are used. However, it has recently been shown that differential privacy can exacerbate existing biases in the data and have disparate impacts on the accuracy of different subgroups of data. In this paper, we aim to study these effects within differentially private deep learning. Specifically, we aim to study how different levels of imbalance in the data affect the accuracy and the fairness of the decisions made by the model, given different levels of privacy. We demonstrate that even small imbalances and loose privacy guarantees can cause disparate impacts.
Code (2)
Tasks
FairnessSimilar Papers 제목 키워드 기반
Differential Privacy in Two-Layer Networks: How DP-SGD Harms Fairness and Robustness
Differentially private learning is essential for training models on sensitive data, but empirical studies consistently show that it can degrade performance, introduce fairness issues like disparate impact, and reduce adv…
Adversarial RobustnessPrivate and Fair Machine Learning: Revisiting the Disparate Impact of Differentially Private SGD
Differential privacy (DP) is a prominent method for protecting information about individuals during data analysis. Training neural networks with differentially private stochastic gradient descent (DPSGD) influences the m…
Fairness Index Measures to Evaluate Bias in Biometric Recognition
The demographic disparity of biometric systems has led to serious concerns regarding their societal impact as well as applicability of such systems in private and public domains. A quantitative evaluation of demographic …
BenchmarkingFairnessThe Impact of Generalization Techniques on the Interplay Among Privacy, Utility, and Fairness in Image Classification
This study investigates the trade-offs between fairness, privacy, and utility in image classification using machine learning (ML). Recent research suggests that generalization techniques can improve the balance between p…
AttributeFairnessimage-classificationImage Classification+1INO-SGD: Addressing Utility Imbalance under Individualized Differential Privacy
Differential privacy (DP) is widely employed in machine learning to protect confidential or sensitive training data from being revealed. As data owners gain greater control over their data due to personal data ownership,…