paper-with-me

홈 › Papers

AdaptiveMix: Improving GAN Training via Feature Space Shrinkage

2023-01-01 · CVPR 2023 1 · Haozhe Liu, Wentian Zhang, Bing Li, Haoqian Wu, Nanjun He, Yawen Huang, Yuexiang Li, Bernard Ghanem, Yefeng Zheng

Due to the outstanding capability for data generation, Generative Adversarial Networks (GANs) have attracted considerable attention in unsupervised learning. However, training GANs is difficult, since the training distribution is dynamic for the discriminator, leading to unstable image representation. In this paper, we address the problem of training GANs from a novel perspective, i.e., robust image classification. Motivated by studies on robust image representation, we propose a simple yet effective module, namely AdaptiveMix, for GANs, which shrinks the regions of training data in the image representation space of the discriminator. Considering it is intractable to directly bound feature space, we propose to construct hard samples and narrow down the feature distance between hard and easy samples. The hard samples are constructed by mixing a pair of training images. We evaluate the effectiveness of our AdaptiveMix with widely-used and state-of-the-art GAN architectures. The evaluation results demonstrate that our AdaptiveMix can facilitate the training of GANs and effectively improve the image quality of generated samples. We also show that our AdaptiveMix can be further applied to image classification and Out-Of-Distribution (OOD) detection tasks, by equipping it with state-of-the-art methods. Extensive experiments on seven publicly available datasets show that our method effectively boosts the performance of baselines. The code is publicly available at https://github.com/WentianZhang-ML/AdaptiveMix.

📄 PDF Abstract BibTeX

Code (1)

wentianzhang-ml/adaptivemix 공식 구현 pytorch

Tasks

image-classificationImage ClassificationOut of Distribution (OOD) Detection

Similar Papers 제목 키워드 기반

Improving GAN Training via Feature Space Shrinkage

2023-03-02 · Haozhe Liu, Wentian Zhang, Bing Li, Haoqian Wu 외

Due to the outstanding capability for data generation, Generative Adversarial Networks (GANs) have attracted considerable attention in unsupervised learning. However, training GANs is difficult, since the training distri…

image-classificationImage ClassificationOut of Distribution (OOD) Detection

Channel Pruning In Quantization-aware Training: An Adaptive Projection-gradient Descent-shrinkage-splitting Method

2022-04-09 · Zhijian Li, Jack Xin

We propose an adaptive projection-gradient descent-shrinkage-splitting method (APGDSSM) to integrate penalty based channel pruning into quantization-aware training (QAT). APGDSSM concurrently searches weights in both the…

Quantization

Shrinkage Methods for Treatment Choice

2022-10-31 · Takuya Ishihara, Daisuke Kurisu

This study examines the problem of determining whether to treat individuals based on observed covariates. The most common decision rule is the conditional empirical success (CES) rule proposed by Manski (2004), which ass…

Introducing shrinkage in heavy-tailed state space models to predict equity excess returns

2019-07-26

We forecast S&P 500 excess returns using a flexible Bayesian econometric state space model with non-Gaussian features at several levels. More precisely, we control for overparameterization via novel global-local shrinkag…

State Space Models

Shrinkage Estimation of Higher Order Bochner Integrals

2022-07-13 · Saiteja Utpala, Bharath K. Sriperumbudur

We consider shrinkage estimation of higher order Hilbert space valued Bochner integrals in a non-parametric setting. We propose estimators that shrink the $U$-statistic estimator of the Bochner integral towards a pre-spe…