Decorrelated Batch Normalization

2000년 도입 · 논문 4편에서 사용

Decorrelated Batch Normalization (DBN) is a normalization technique which not just centers and scales activations but whitens them. ZCA whitening instead of PCA whitening is employed since PCA whitening causes a problem called *stochastic axis swapping*, which is detrimental to learning.