Multiclass non-Adversarial Image Synthesis, with Application to Classification from Very Small Sample
The generation of synthetic images is currently being dominated by Generative Adversarial Networks (GANs). Despite their outstanding success in generating realistic looking images, they still suffer from major drawbacks, including an unstable and highly sensitive training procedure, mode-collapse and mode-mixture, and dependency on large training sets. In this work we present a novel non-adversarial generative method - Clustered Optimization of LAtent space (COLA), which overcomes some of the limitations of GANs, and outperforms GANs when training data is scarce. In the full data regime, our method is capable of generating diverse multi-class images with no supervision, surpassing previous non-adversarial methods in terms of image quality and diversity. In the small-data regime, where only a small sample of labeled images is available for training with no access to additional unlabeled data, our results surpass state-of-the-art GAN models trained on the same amount of data. Finally, when utilizing our model to augment small datasets, we surpass the state-of-the-art performance in small-sample classification tasks on challenging datasets, including CIFAR-10, CIFAR-100, STL-10 and Tiny-ImageNet. A theoretical analysis supporting the essence of the method is presented.
Code (0)
등록된 구현이 없습니다.
Tasks
CoLADiversityGeneral ClassificationImage GenerationSimilar Papers 제목 키워드 기반
Multiclass ASMA vs Targeted PGD Attack in Image Segmentation
Deep learning networks have demonstrated high performance in a large variety of applications, such as image classification, speech recognition, and natural language processing. However, there exists a major vulnerability…
Adversarial AttackClassificationDeep Learningimage-classification+6Consistent Robust Adversarial Prediction for General Multiclass Classification
We propose a robust adversarial prediction framework for general multiclass classification. Our method seeks predictive distributions that robustly optimize non-convex and non-continuous multiclass loss metrics against t…
ClassificationGeneral ClassificationPredictionThe Multimarginal Optimal Transport Formulation of Adversarial Multiclass Classification
We study a family of adversarial multiclass classification problems and provide equivalent reformulations in terms of: 1) a family of generalized barycenter problems introduced in the paper and 2) a family of multimargin…
Binary ClassificationClassificationRobust classificationOn the existence of solutions to adversarial training in multiclass classification
We study three models of the problem of adversarial training in multiclass classification designed to construct robust classifiers against adversarial perturbations of data in the agnostic-classifier setting. We prove th…
Binary ClassificationUnveiling the Role of Randomization in Multiclass Adversarial Classification: Insights from Graph Theory
Randomization as a mean to improve the adversarial robustness of machine learning models has recently attracted significant attention. Unfortunately, much of the theoretical analysis so far has focused on binary classifi…
Adversarial RobustnessBinary ClassificationClassification