paper-with-me

홈 › Papers

DGL-GAN: Discriminator Guided Learning for GAN Compression

2021-12-13 · Yuesong Tian, Li Shen, Xiang Tian, DaCheng Tao, Zhifeng Li, Wei Liu, Yaowu Chen

Generative Adversarial Networks (GANs) with high computation costs, e.g., BigGAN and StyleGAN2, have achieved remarkable results in synthesizing high-resolution images from random noise. Reducing the computation cost of GANs while keeping generating photo-realistic images is a challenging field. In this work, we propose a novel yet simple {\bf D}iscriminator {\bf G}uided {\bf L}earning approach for compressing vanilla {\bf GAN}, dubbed {\bf DGL-GAN}. Motivated by the phenomenon that the teacher discriminator may contain some meaningful information about both real images and fake images, we merely transfer the knowledge from the teacher discriminator via the adversarial interaction between the teacher discriminator and the student generator. We apply DGL-GAN to compress the two most representative large-scale vanilla GANs, i.e., StyleGAN2 and BigGAN. Experiments show that DGL-GAN achieves state-of-the-art (SOTA) results on both StyleGAN2 and BigGAN. Moreover, DGL-GAN is also effective in boosting the performance of original uncompressed GANs. Original uncompressed StyleGAN2 boosted with DGL-GAN achieves FID 2.65 on FFHQ, which achieves a new state-of-the-art performance. Code and models are available at \url{https://github.com/yuesongtian/DGL-GAN}

📄 PDF Abstract BibTeX arXiv:2112.06502

Code (1)

yuesongtian/dgl-gan 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Weight Demodulation 설명 없음
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
HuMan(Expedia)||How do I get a human at Expedia? How do I get a human at Expedia? How Do I Get a Human at Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Real-Time Help & Exclusive…
Residual Connection 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Residual Block Residual Blocks are skip-connection blocks that learn residual functions with reference to the layer inputs, instead of learning unreferenced functions. They were introduced…
Feedforward Network A Feedforward Network, or a Multilayer Perceptron (MLP), is a neural network with solely densely connected layers. This is the classic neural network architecture of the…
Six Ways To Communicate To Someone At Expedia Via Phone And Email's. To communicate or get human at Expedia, the quickest option is typically to call their customer service at +1-888-829-0881 or +1(805) 330 (4056). You can also use the live chat…

Similar Papers 제목 키워드 기반

Revisiting Discriminator in GAN Compression: A Generator-discriminator Cooperative Compression Scheme

2021-10-27 · NeurIPS 2021 12 · Shaojie Li, Jie Wu, Xuefeng Xiao, Fei Chao 외

Recently, a series of algorithms have been explored for GAN compression, which aims to reduce tremendous computational overhead and memory usages when deploying GANs on resource-constrained edge devices. However, most of…

EGIC: Enhanced Low-Bit-Rate Generative Image Compression Guided by Semantic Segmentation

2023-09-06 · Nikolai Körber, Eduard Kromer, Andreas Siebert, Sascha Hauke 외

We introduce EGIC, an enhanced generative image compression method that allows traversing the distortion-perception curve efficiently from a single model. EGIC is based on two novel building blocks: i) OASIS-C, a conditi…

DecoderImage CompressionSemantic Segmentation

Improving Statistical Fidelity for Neural Image Compression with Implicit Local Likelihood Models

2023-01-26 · Matthew J. Muckley, Alaaeldin El-Nouby, Karen Ullrich, Hervé Jégou 외

Lossy image compression aims to represent images in as few bits as possible while maintaining fidelity to the original. Theoretical results indicate that optimizing distortion metrics such as PSNR or MS-SSIM necessarily …

Image CompressionMS-SSIMSSIM

Discriminator-Cooperated Feature Map Distillation for GAN Compression

2022-12-29 · CVPR 2023 1 · Tie Hu, Mingbao Lin, Lizhou You, Fei Chao 외

Despite excellent performance in image generation, Generative Adversarial Networks (GANs) are notorious for its requirements of enormous storage and intensive computation. As an awesome ''performance maker'', knowledge d…

Image GenerationKnowledge Distillation

AutoGAN-Distiller: Searching to Compress Generative Adversarial Networks

2020-06-15 · ICML 2020 1 · Yonggan Fu, Wuyang Chen, Haotao Wang, Haoran Li 외

The compression of Generative Adversarial Networks (GANs) has lately drawn attention, due to the increasing demand for deploying GANs into mobile devices for numerous applications such as image translation, enhancement a…

AutoMLKnowledge DistillationSuper-ResolutionTranslation