Low-shot Learning via Covariance-Preserving Adversarial Augmentation Networks
Deep neural networks suffer from over-fitting and catastrophic forgetting when trained with small data. One natural remedy for this problem is data augmentation, which has been recently shown to be effective. However, previous works either assume that intra-class variances can always be generalized to new classes, or employ naive generation methods to hallucinate finite examples without modeling their latent distributions. In this work, we propose Covariance-Preserving Adversarial Augmentation Networks to overcome existing limits of low-shot learning. Specifically, a novel Generative Adversarial Network is designed to model the latent distribution of each novel class given its related base counterparts. Since direct estimation of novel classes can be inductively biased, we explicitly preserve covariance information as the `variability' of base examples during the generation process. Empirical results show that our model can generate realistic yet diverse examples, leading to substantial improvements on the ImageNet benchmark over the state of the art.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationGenerative Adversarial NetworkSmall Data Image ClassificationSimilar Papers 제목 키워드 기반
Riemannian Geometry-Preserving Variational Autoencoder for MI-BCI Data Augmentation
This paper addresses the challenge of generating synthetic electroencephalogram (EEG) covariance matrices for motor imagery brain-computer interface (MI-BCI) applications. Objective: We aim to develop a generative model …
Data AugmentationCOSTA: Covariance-Preserving Feature Augmentation for Graph Contrastive Learning
Graph contrastive learning (GCL) improves graph representation learning, leading to SOTA on various downstream tasks. The graph augmentation step is a vital but scarcely studied step of GCL. In this paper, we show that t…
Contrastive LearningGraph Representation LearningRepresentation LearningAdversarial Semantic Augmentation for Training Generative Adversarial Networks under Limited Data
Generative adversarial networks (GANs) have made remarkable achievements in synthesizing images in recent years. Typically, training GANs requires massive data, and the performance of GANs deteriorates significantly when…
Data AugmentationSelf-Training with Purpose Preserving Augmentation Improves Few-shot Generative Dialogue State Tracking
In dialogue state tracking (DST), labeling the dataset involves considerable human labor. We propose a new self-training framework for few-shot generative DST that utilize unlabeled data. Our self-training method iterati…
Dialogue State TrackingAdversarial Feature Augmentation for Cross-domain Few-shot Classification
Existing methods based on meta-learning predict novel-class labels for (target domain) testing tasks via meta knowledge learned from (source domain) training tasks of base classes. However, most existing works may fail t…
ClassificationCross-Domain Few-ShotFew-Shot LearningMeta-Learning