paper-with-me

홈 › Papers

An Improved Self-supervised GAN via Adversarial Training

2019-05-14 · Ngoc-Trung Tran, Viet-Hung Tran, Ngoc-Bao Nguyen, Ngai-Man Cheung

We propose to improve unconditional Generative Adversarial Networks (GAN) by training the self-supervised learning with the adversarial process. In particular, we apply self-supervised learning via the geometric transformation on input images and assign the pseudo-labels to these transformed images. (i) In addition to the GAN task, which distinguishes data (real) versus generated (fake) samples, we train the discriminator to predict the correct pseudo-labels of real transformed samples (classification task). Importantly, we find out that simultaneously training the discriminator to classify the fake class from the pseudo-classes of real samples for the classification task will improve the discriminator and subsequently lead better guides to train generator. (ii) The generator is trained by attempting to confuse the discriminator for not only the GAN task but also the classification task. For the classification task, the generator tries to confuse the discriminator recognizing the transformation of its output as one of the real transformed classes. Especially, we exploit that when the generator creates samples that result in a similar loss (via cross-entropy) as that of the real ones, the training is more stable and the generator distribution tends to match better the data distribution. When integrating our techniques into a state-of-the-art Auto-Encoder (AE) based-GAN model, they help to significantly boost the model's performance and also establish new state-of-the-art Fr\'echet Inception Distance (FID) scores in the literature of unconditional GAN for CIFAR-10 and STL-10 datasets.

📄 PDF Abstract BibTeX arXiv:1905.05469

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationGeneral ClassificationSelf-Supervised Learning

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Dogecoin Customer Service Number +1-833-534-1729 설명 없음

Similar Papers 제목 키워드 기반

Adversarial Self-Supervised Contrastive Learning

2020-06-13 · NeurIPS 2020 12 · Minseon Kim, Jihoon Tack, Sung Ju Hwang

Existing adversarial learning approaches mostly use class labels to generate adversarial samples that lead to incorrect predictions, which are then used to augment the training of the model for improved robustness. While…

Adversarial AttackContrastive LearningSelf-Supervised LearningTransfer Learning

Self-supervised Adversarial Training of Monocular Depth Estimation against Physical-World Attacks

2024-06-09 · Zhiyuan Cheng, Cheng Han, James Liang, Qifan Wang 외

Monocular Depth Estimation (MDE) plays a vital role in applications such as autonomous driving. However, various attacks target MDE models, with physical attacks posing significant threats to system security. Traditional…

Adversarial RobustnessAutonomous DrivingContrastive LearningDepth Estimation+1

Adversarial Training Methods for Semi-Supervised Text Classification

2016-05-25 · Takeru Miyato, Andrew M. Dai, Ian Goodfellow

Adversarial training provides a means of regularizing supervised learning algorithms while virtual adversarial training is able to extend supervised learning algorithms to the semi-supervised setting. However, both metho…

ClassificationGeneral ClassificationSemi-Supervised Text ClassificationSentiment Analysis+2

A Aelf-supervised Tibetan-chinese Vocabulary Alignment Method Based On Adversarial Learning

2021-10-04 · Enshuai Hou, Jie Zhu

Tibetan is a low-resource language. In order to alleviate the shortage of parallel corpus between Tibetan and Chinese, this paper uses two monolingual corpora and a small number of seed dictionaries to learn the semi-sup…

Decoupled Adversarial Contrastive Learning for Self-supervised Adversarial Robustness

2022-07-22 · Chaoning Zhang, Kang Zhang, Chenshuang Zhang, Axi Niu 외

Adversarial training (AT) for robust representation learning and self-supervised learning (SSL) for unsupervised representation learning are two active research fields. Integrating AT into SSL, multiple prior works have …

Adversarial RobustnessContrastive LearningPhilosophyRepresentation Learning+1