paper-with-me

홈 › Papers

CoroNetGAN: Controlled Pruning of GANs via Hypernetworks

2024-03-13 · Aman Kumar, Khushboo Anand, Shubham Mandloi, Ashutosh Mishra, Avinash Thakur, Neeraj Kasera, Prathosh A P

Generative Adversarial Networks (GANs) have proven to exhibit remarkable performance and are widely used across many generative computer vision applications. However, the unprecedented demand for the deployment of GANs on resource-constrained edge devices still poses a challenge due to huge number of parameters involved in the generation process. This has led to focused attention on the area of compressing GANs. Most of the existing works use knowledge distillation with the overhead of teacher dependency. Moreover, there is no ability to control the degree of compression in these methods. Hence, we propose CoroNet-GAN for compressing GAN using the combined strength of differentiable pruning method via hypernetworks. The proposed method provides the advantage of performing controllable compression while training along with reducing training time by a substantial factor. Experiments have been done on various conditional GAN architectures (Pix2Pix and CycleGAN) to signify the effectiveness of our approach on multiple benchmark datasets such as Edges-to-Shoes, Horse-to-Zebra and Summer-to-Winter. The results obtained illustrate that our approach succeeds to outperform the baselines on Zebra-to-Horse and Summer-to-Winter achieving the best FID score of 32.3 and 72.3 respectively, yielding high-fidelity images across all the datasets. Additionally, our approach also outperforms the state-of-the-art methods in achieving better inference time on various smart-phone chipsets and data-types making it a feasible solution for deployment on edge devices.

📄 PDF Abstract BibTeX arXiv:2403.08261

Code (0)

등록된 구현이 없습니다.

Tasks

Knowledge Distillation

Methods 이 논문이 사용한 방법론

Pruning 설명 없음
Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

DHP: Differentiable Meta Pruning via HyperNetworks

2020-03-30 · ECCV 2020 8 · Yawei Li, Shuhang Gu, Kai Zhang, Luc van Gool 외

Network pruning has been the driving force for the acceleration of neural networks and the alleviation of model storage/transmission burden. With the advent of AutoML and neural architecture search (NAS), pruning has bec…

AutoMLDenoisingimage-classificationImage Classification+5

HyperGANStrument: Instrument Sound Synthesis and Editing with Pitch-Invariant Hypernetworks

2024-01-09 · Zhe Zhang, Taketo Akama

GANStrument, exploiting GANs with a pitch-invariant feature extractor and instance conditioning technique, has shown remarkable capabilities in synthesizing realistic instrument sounds. To further improve the reconstruct…

Diversity

A Brief Review of Hypernetworks in Deep Learning

2023-06-12 · Vinod Kumar Chauhan, Jiandong Zhou, Ping Lu, Soheila Molaei 외

Hypernetworks, or hypernets for short, are neural networks that generate weights for another neural network, known as the target network. They have emerged as a powerful deep learning technique that allows for greater fl…

Causal InferenceContinual LearningDeep LearningModel Compression+3

Transferring Unconditional to Conditional GANs with Hyper-Modulation

2021-12-04 · Héctor Laria, Yaxing Wang, Joost Van de Weijer, Bogdan Raducanu

GANs have matured in recent years and are able to generate high-resolution, realistic images. However, the computational resources and the data required for the training of high-quality GANs are enormous, and the study o…

Conditional Image GenerationContrastive LearningTransfer Learning

Learning Personalized Utility Functions for Drivers in Ride-hailing Systems Using Ensemble Hypernetworks

2025-06-21 · Weiming Mai, Jie Gao, Oded Cats

In ride-hailing systems, drivers decide whether to accept or reject ride requests based on factors such as order characteristics, traffic conditions, and personal preferences. Accurately predicting these decisions is ess…

Ensemble LearningUncertainty Quantification