Adversarial Sampling for Fairness Testing in Deep Neural Network
In this research, we focus on the usage of adversarial sampling to test for the fairness in the prediction of deep neural network model across different classes of image in a given dataset. While several framework had been proposed to ensure robustness of machine learning model against adversarial attack, some of which includes adversarial training algorithm. There is still the pitfall that adversarial training algorithm tends to cause disparity in accuracy and robustness among different group. Our research is aimed at using adversarial sampling to test for fairness in the prediction of deep neural network model across different classes or categories of image in a given dataset. We successfully demonstrated a new method of ensuring fairness across various group of input in deep neural network classifier. We trained our neural network model on the original image, and without training our model on the perturbed or attacked image. When we feed the adversarial samplings to our model, it was able to predict the original category/ class of the image the adversarial sample belongs to. We also introduced and used the separation of concern concept from software engineering whereby there is an additional standalone filter layer that filters perturbed image by heavily removing the noise or attack before automatically passing it to the network for classification, we were able to have accuracy of 93.3%. Cifar-10 dataset have ten categories of dataset, and so, in order to account for fairness, we applied our hypothesis across each categories of dataset and were able to get a consistent result and accuracy.
Code (0)
등록된 구현이 없습니다.
Tasks
Adversarial AttackFairnessMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Automatic Fairness Testing of Neural Classifiers through Adversarial Sampling
Although deep learning has demonstrated astonishing performance in many applications, there are still concerns about its dependability. One desirable property of deep learning applications with societal impact is fairnes…
Deep LearningFairnesstext-classificationText ClassificationFairness Testing of Deep Image Classification with Adequacy Metrics
As deep image classification applications, e.g., face recognition, become increasingly prevalent in our daily lives, their fairness issues raise more and more concern. It is thus crucial to comprehensively test the fairn…
ClassificationFace RecognitionFairnessimage-classification+1Poisoning Attacks on Fair Machine Learning
Both fair machine learning and adversarial learning have been extensively studied. However, attacking fair machine learning models has received less attention. In this paper, we present a framework that seeks to effectiv…
BIG-bench Machine LearningFairnessOn Adversarial Bias and the Robustness of Fair Machine Learning
Optimizing prediction accuracy can come at the expense of fairness. Towards minimizing discrimination against a group, fair machine learning algorithms strive to equalize the behavior of a model across different groups, …
BIG-bench Machine LearningData PoisoningFairnessOn the Fairness of Generative Adversarial Networks (GANs)
Generative adversarial networks (GANs) are one of the greatest advances in AI in recent years. With their ability to directly learn the probability distribution of data, and then sample synthetic realistic data. Many app…
Data AugmentationFairnessRepresentation Learning