Parallel/distributed implementation of cellular training for generative adversarial neural networks
Generative adversarial networks (GANs) are widely used to learn generative models. GANs consist of two networks, a generator and a discriminator, that apply adversarial learning to optimize their parameters. This article presents a parallel/distributed implementation of a cellular competitive coevolutionary method to train two populations of GANs. A distributed memory parallel implementation is proposed for execution in high performance/supercomputing centers. Efficient results are reported on addressing the generation of handwritten digits (MNIST dataset samples). Moreover, the proposed implementation is able to reduce the training times and scale properly when considering different grid sizes for training.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Horn: A System for Parallel Training and Regularizing of Large-Scale Neural Networks
I introduce a new distributed system for effective training and regularizing of Large-Scale Neural Networks on distributed computing architectures. The experiments demonstrate the effectiveness of flexible model partitio…
Distributed ComputingGeneral ClassificationCell-Free versus Cellular Massive MIMO:What Processing is Needed for Cell-Free to Win?
—Communication by joint signal processing from many distributed access points, called Cell-free Massive MIMO, is a potential beyond-5G network infrastructure. The aim of this paper is to provide the first comprehensiv…
Popt4jlib: A Parallel/Distributed Optimization Library for Java
This paper describes the architectural design as well as key implementation details of the Open Source popt4jlib library (https://githhub.org/ioannischristou/popt4jlib) that contains a fairly large number of meta-heurist…
Distributed OptimizationA Survey on Distributed Evolutionary Computation
The rapid development of parallel and distributed computing paradigms has brought about great revolution in computing. Thanks to the intrinsic parallelism of evolutionary computation (EC), it is natural to implement EC o…
Distributed ComputingDistributed OptimizationSurveyA Linear Algebraic Approach to Model Parallelism in Deep Learning
Training deep neural networks (DNNs) in large-cluster computing environments is increasingly necessary, as networks grow in size and complexity. Local memory and processing limitations require robust data and model paral…
Deep Learning