paper-with-me

Papers

Restrained Generative Adversarial Network against Overfitting in Numeric Data Augmentation

2020-10-26 · Wei Wang, Yimeng Chai, Tao Cui, Chuang Wang, Baohua Zhang, Yue Li, Yi An

In recent studies, Generative Adversarial Network (GAN) is one of the popular schemes to augment the image dataset. However, in our study we find the generator G in the GAN fails to generate numerical data in lower-dimensional spaces, and we address overfitting in the generation. By analyzing the Directed Graphical Model (DGM), we propose a theoretical restraint, independence on the loss function, to suppress the overfitting. Practically, as the Statically Restrained GAN (SRGAN) and Dynamically Restrained GAN (DRGAN), two frameworks are proposed to employ the theoretical restraint to the network structure. In the static structure, we predefined a pair of particular network topologies of G and D as the restraint, and quantify such restraint by the interpretable metric Similarity of the Restraint (SR). While for DRGAN we design an adjustable dropout module for the restraint function. In the widely carried out 20 group experiments, on four public numerical class imbalance datasets and five classifiers, the static and dynamic methods together produce the best augmentation results of 19 from 20; and both two methods simultaneously generate 14 of 20 groups of the top-2 best, proving the effectiveness and feasibility of the theoretical restraints.

📄 PDF Abstract BibTeX arXiv:2010.13549

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationGenerative Adversarial Network

Methods 이 논문이 사용한 방법론

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Benign Overfitting in Adversarially Robust Linear Classification

2021-12-31 · Jinghui Chen, Yuan Cao, Quanquan Gu

"Benign overfitting", where classifiers memorize noisy training data yet still achieve a good generalization performance, has drawn great attention in the machine learning community. To explain this surprising phenomenon…

Classification

A PDE-based Explanation of Extreme Numerical Sensitivities and Edge of Stability in Training Neural Networks

2022-06-04 · Yuxin Sun, Dong Lao, Ganesh Sundaramoorthi, Anthony Yezzi

We discover restrained numerical instabilities in current training practices of deep networks with stochastic gradient descent (SGD), and its variants. We show numerical error (on the order of the smallest floating point…

Unveiling Hidden Visual Information: A Reconstruction Attack Against Adversarial Visual Information Hiding

2024-08-08 · Jonggyu Jang, Hyeonsu Lyu, Seongjin Hwang, Hyun Jong Yang

This paper investigates the security vulnerabilities of adversarial-example-based image encryption by executing data reconstruction (DR) attacks on encrypted images. A representative image encryption method is the advers…

Reconstruction Attack

Fixing Data Augmentation to Improve Adversarial Robustness

2021-03-02 · Sylvestre-Alvise Rebuffi, Sven Gowal, Dan A. Calian, Florian Stimberg 외

Adversarial training suffers from robust overfitting, a phenomenon where the robust test accuracy starts to decrease during training. In this paper, we focus on both heuristics-driven and data-driven augmentations as a m…

Adversarial RobustnessData Augmentation

Understanding Catastrophic Overfitting in Single-step Adversarial Training

2020-10-05 · Hoki Kim, Woojin Lee, Jaewook Lee

Although fast adversarial training has demonstrated both robustness and efficiency, the problem of "catastrophic overfitting" has been observed. This is a phenomenon in which, during single-step adversarial training, the…