paper-with-me

홈 › Papers

FairAdaBN: Mitigating unfairness with adaptive batch normalization and its application to dermatological disease classification

2023-03-15 · Zikang Xu, Shang Zhao, Quan Quan, Qingsong Yao, S. Kevin Zhou

Deep learning is becoming increasingly ubiquitous in medical research and applications while involving sensitive information and even critical diagnosis decisions. Researchers observe a significant performance disparity among subgroups with different demographic attributes, which is called model unfairness, and put lots of effort into carefully designing elegant architectures to address unfairness, which poses heavy training burden, brings poor generalization, and reveals the trade-off between model performance and fairness. To tackle these issues, we propose FairAdaBN by making batch normalization adaptive to sensitive attribute. This simple but effective design can be adopted to several classification backbones that are originally unaware of fairness. Additionally, we derive a novel loss function that restrains statistical parity between subgroups on mini-batches, encouraging the model to converge with considerable fairness. In order to evaluate the trade-off between model performance and fairness, we propose a new metric, named Fairness-Accuracy Trade-off Efficiency (FATE), to compute normalized fairness improvement over accuracy drop. Experiments on two dermatological datasets show that our proposed method outperforms other methods on fairness criteria and FATE.

📄 PDF Abstract BibTeX arXiv:2303.08325

Code (1)

xuzikang/fairadabn 공식 구현 pytorch

Tasks

AttributeFairness

Methods 이 논문이 사용한 방법론

Batch Normalization 설명 없음

Similar Papers 제목 키워드 기반

BCN: Batch Channel Normalization for Image Classification

2023-12-01 · Afifa Khaled, Chao Li, Jia Ning, Kun He

Normalization techniques have been widely used in the field of deep learning due to their capability of enabling higher learning rates and are less careful in initialization. However, the effectiveness of popular normali…

Classificationimage-classificationImage Classification

Data-Free Quantization with Accurate Activation Clipping and Adaptive Batch Normalization

2022-04-08 · Yefei He, Luoming Zhang, Weijia Wu, Hong Zhou

Data-free quantization is a task that compresses the neural network to low bit-width without access to original training data. Most existing data-free quantization methods cause severe performance degradation due to inac…

Data Free QuantizationQuantization

Domain-Aware Fine-Tuning: Enhancing Neural Network Adaptability

2023-08-15 · Seokhyeon Ha, Sunbeom Jung, Jungwoo Lee

Fine-tuning pre-trained neural network models has become a widely adopted approach across various domains. However, it can lead to the distortion of pre-trained feature extractors that already possess strong generalizati…

Batch Layer Normalization, A new normalization layer for CNNs and RNN

2022-09-19 · Amir Ziaee, Erion Çano

This study introduces a new normalization layer termed Batch Layer Normalization (BLN) to reduce the problem of internal covariate shift in deep neural network layers. As a combined version of batch and layer normalizati…

Layer Normalization

2016-07-21 · Jimmy Lei Ba, Jamie Ryan Kiros, Geoffrey E. Hinton

Training state-of-the-art, deep neural networks is computationally expensive. One way to reduce the training time is to normalize the activities of the neurons. A recently introduced technique called batch normalization …