paper-with-me

Papers

Improving GANs for Long-Tailed Data through Group Spectral Regularization

2022-08-21 · Harsh Rangwani, Naman Jaswani, Tejan Karmali, Varun Jampani, R. Venkatesh Babu

Deep long-tailed learning aims to train useful deep networks on practical, real-world imbalanced distributions, wherein most labels of the tail classes are associated with a few samples. There has been a large body of work to train discriminative models for visual recognition on long-tailed distribution. In contrast, we aim to train conditional Generative Adversarial Networks, a class of image generation models on long-tailed distributions. We find that similar to recognition, state-of-the-art methods for image generation also suffer from performance degradation on tail classes. The performance degradation is mainly due to class-specific mode collapse for tail classes, which we observe to be correlated with the spectral explosion of the conditioning parameter matrix. We propose a novel group Spectral Regularizer (gSR) that prevents the spectral explosion alleviating mode collapse, which results in diverse and plausible image generation even for tail classes. We find that gSR effectively combines with existing augmentation and regularization techniques, leading to state-of-the-art image generation performance on long-tailed data. Extensive experiments demonstrate the efficacy of our regularizer on long-tailed datasets with different degrees of imbalance.

📄 PDF Abstract BibTeX arXiv:2208.09932

Code (1)

val-iisc/gSRGAN 공식 구현 pytorch

Tasks

Conditional Image GenerationImage Generation

Methods 이 논문이 사용한 방법론

BiGAN A BiGAN, or Bidirectional GAN, is a type of generative adversarial network where the generator not only maps latent samples to generated data, but also has an inverse…

Similar Papers 제목 키워드 기반

NoisyTwins: Class-Consistent and Diverse Image Generation through StyleGANs

2023-04-12 · CVPR 2023 1 · Harsh Rangwani, Lavish Bansal, Kartik Sharma, Tejan Karmali 외

StyleGANs are at the forefront of controllable image generation as they produce a latent space that is semantically disentangled, making it suitable for image editing and manipulation. However, the performance of StyleGA…

Conditional Image GenerationDiversityImage Generation

Class Balancing GAN with a Classifier in the Loop

2021-06-17 · Harsh Rangwani, Konda Reddy Mopuri, R. Venkatesh Babu

Generative Adversarial Networks (GANs) have swiftly evolved to imitate increasingly complex image distributions. However, majority of the developments focus on performance of GANs on balanced datasets. We find that the e…

Statistical Guarantees of Group-Invariant GANs

2023-05-22 · Ziyu Chen, Markos A. Katsoulakis, Luc Rey-Bellet, Wei Zhu

Group-invariant generative adversarial networks (GANs) are a type of GANs in which the generators and discriminators are hardwired with group symmetries. Empirical studies have shown that these networks are capable of le…

Data Augmentation

Taming the Tail in Class-Conditional GANs: Knowledge Sharing via Unconditional Training at Lower Resolutions

2024-02-26 · CVPR 2024 1 · Saeed Khorram, Mingqi Jiang, Mohamad Shahbazi, Mohamad H. Danesh 외

Despite extensive research on training generative adversarial networks (GANs) with limited training data, learning to generate images from long-tailed training distributions remains fairly unexplored. In the presence of …

Diversity

LPT: Long-tailed Prompt Tuning for Image Classification

2022-10-03 · Bowen Dong, Pan Zhou, Shuicheng Yan, WangMeng Zuo

For long-tailed classification, most works often pretrain a big model on a large-scale dataset, and then fine-tune the whole model for adapting to long-tailed data. Though promising, fine-tuning the whole pretrained mode…

Classificationimage-classificationImage ClassificationLong-tail Learning