Easy Batch Normalization
It was shown that adversarial examples improve object recognition. But what about their opposite side, easy examples? Easy examples are samples that the machine learning model classifies correctly with high confidence. In our paper, we are making the first step toward exploring the potential benefits of using easy examples in the training procedure of neural networks. We propose to use an auxiliary batch normalization for easy examples for the standard and robust accuracy improvement.
Code (0)
등록된 구현이 없습니다.
Tasks
Object RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Exploring the Efficacy of Group-Normalization in Deep Learning Models for Alzheimer's Disease Classification
Batch Normalization is an important approach to advancing deep learning since it allows multiple networks to train simultaneously. A problem arises when normalizing along the batch dimension because B.N.'s error increase…
$L_2$BN: Enhancing Batch Normalization by Equalizing the $L_2$ Norms of Features
In this paper, we analyze batch normalization from the perspective of discriminability and find the disadvantages ignored by previous studies: the difference in $l_2$ norms of sample features can hinder batch normalizati…
Acoustic Scene Classificationimage-classificationImage ClassificationScene ClassificationBatch Normalization and the impact of batch structure on the behavior of deep convolution networks
Batch normalization was introduced in 2015 to speed up training of deep convolution networks by normalizing the activations across the current batch to have zero mean and unity variance. The results presented here show a…
UnitySandwich Batch Normalization: A Drop-In Replacement for Feature Distribution Heterogeneity
We present Sandwich Batch Normalization (SaBN), a frustratingly easy improvement of Batch Normalization (BN) with only a few lines of code changes. SaBN is motivated by addressing the inherent feature distribution hetero…
Adversarial DefenseConditional Image GenerationImage GenerationNeural Architecture Search+1Extended Batch Normalization
Batch normalization (BN) has become a standard technique for training the modern deep networks. However, its effectiveness diminishes when the batch size becomes smaller, since the batch statistics estimation becomes ina…
Image Classification