PConv: Simple yet Effective Convolutional Layer for Generative Adversarial Network
This paper presents a novel convolutional layer, called perturbed convolution (PConv), which focuses on achieving two goals simultaneously: improving the generative adversarial network (GAN) performance and alleviating the memorization problem in which the discriminator memorizes all images from a given dataset as training progresses. In PConv, perturbed features are generated by randomly disturbing an input tensor before performing the convolution operation. This approach is simple but surprisingly effective. First, to produce a similar output even with the perturbed tensor, each layer in the discriminator should learn robust features having a small local Lipschitz value. Second, since the input tensor is randomly perturbed during the training procedure like the dropout in neural networks, the memorization problem could be alleviated. To show the generalization ability of the proposed method, we conducted extensive experiments with various loss functions and datasets including CIFAR-10, CelebA, CelebA-HQ, LSUN, and tiny-ImageNet. The quantitative evaluations demonstrate that PConv effectively boosts the performance of GAN and conditional GAN in terms of Frechet inception distance (FID).
Code (0)
등록된 구현이 없습니다.
Tasks
Generative Adversarial NetworkMemorizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Projection-based Point Convolution for Efficient Point Cloud Segmentation
Understanding point cloud has recently gained huge interests following the development of 3D scanning devices and the accumulation of large-scale 3D data. Most point cloud processing algorithms can be classified as eithe…
Point Cloud SegmentationA few filters are enough: Convolutional Neural Network for P300 Detection
Over the past decade, convolutional neural networks (CNNs) have become the driving force of an ever-increasing set of applications, achieving state-of-the-art performance. Most of the modern CNN architectures are compose…
EEGElectroencephalogram (EEG)General ClassificationKPConvX: Modernizing Kernel Point Convolution with Kernel Attention
In the field of deep point cloud understanding, KPConv is a unique architecture that uses kernel points to locate convolutional weights in space, instead of relying on Multi-Layer Perceptron (MLP) encodings. While it ini…
3D Point Cloud ClassificationSemantic SegmentationCompConv: A Compact Convolution Module for Efficient Feature Learning
Convolutional Neural Networks (CNNs) have achieved remarkable success in various computer vision tasks but rely on tremendous computational cost. To solve this problem, existing approaches either compress well-trained la…
Interpolated Convolutional Networks for 3D Point Cloud Understanding
Point cloud is an important type of 3D representation. However, directly applying convolutions on point clouds is challenging due to the sparse, irregular and unordered data structure. In this paper, we propose a novel I…
3D Part Segmentation3D Point Cloud ClassificationSemantic Parsing