MaxUp

2000년 도입 · 논문 2편에서 사용

MaxUp is an adversarial data augmentation technique for improving the generalization performance of machine learning models. The idea is to generate a set of augmented data with some random perturbations or transforms, and minimize the maximum, or worst case loss over the augmented data. By doing so, we implicitly introduce a smoothness or robustness regularization against the random perturbations, and hence improve the generation performance. For example, in the case of Gaussian perturbation, MaxUp is asymptotically equivalent to using the gradient norm of the loss as a penalty to encourage smoothness.

출처: MaxUp: A Simple Way to Improve Generalization of Neural Network Training

소개 논문: MaxUp: A Simple Way to Improve Generalization of Neural Network Training