paper-with-me

홈 › Papers

Spiking Generative Adversarial Networks With a Neural Network Discriminator: Local Training, Bayesian Models, and Continual Meta-Learning

2021-11-02 · Bleema Rosenfeld, Osvaldo Simeone, Bipin Rajendran

Neuromorphic data carries information in spatio-temporal patterns encoded by spikes. Accordingly, a central problem in neuromorphic computing is training spiking neural networks (SNNs) to reproduce spatio-temporal spiking patterns in response to given spiking stimuli. Most existing approaches model the input-output behavior of an SNN in a deterministic fashion by assigning each input to a specific desired output spiking sequence. In contrast, in order to fully leverage the time-encoding capacity of spikes, this work proposes to train SNNs so as to match distributions of spiking signals rather than individual spiking signals. To this end, the paper introduces a novel hybrid architecture comprising a conditional generator, implemented via an SNN, and a discriminator, implemented by a conventional artificial neural network (ANN). The role of the ANN is to provide feedback during training to the SNN within an adversarial iterative learning strategy that follows the principle of generative adversarial network (GANs). In order to better capture multi-modal spatio-temporal distribution, the proposed approach -- termed SpikeGAN -- is further extended to support Bayesian learning of the generator's weight. Finally, settings with time-varying statistics are addressed by proposing an online meta-learning variant of SpikeGAN. Experiments bring insights into the merits of the proposed approach as compared to existing solutions based on (static) belief networks and maximum likelihood (or empirical risk minimization).

📄 PDF Abstract BibTeX arXiv:2111.01750

Code (0)

등록된 구현이 없습니다.

Tasks

Generative Adversarial NetworkMeta-Learning

Similar Papers 제목 키워드 기반

Spiking Generative Adversarial Network with Attention Scoring Decoding

2023-05-17 · Linghao Feng, Dongcheng Zhao, Yi Zeng

Generative models based on neural networks present a substantial challenge within deep learning. As it stands, such models are primarily limited to the domain of artificial neural networks. Spiking neural networks, as th…

Generative Adversarial Network

On Catastrophic Forgetting and Mode Collapse in Generative Adversarial Networks

2018-07-11 · Hoang Thanh-Tung, Truyen Tran

In this paper, we show that Generative Adversarial Networks (GANs) suffer from catastrophic forgetting even when they are trained to approximate a single target distribution. We show that GAN training is a continual lear…

Continual Learning

A New Distributed Method for Training Generative Adversarial Networks

2021-07-19 · Jinke Ren, Chonghe Liu, Guanding Yu, Dongning Guo

Generative adversarial networks (GANs) are emerging machine learning models for generating synthesized data similar to real data by jointly training a generator and a discriminator. In many applications, data and computa…

On the Benefits of Inducing Local Lipschitzness for Robust Generative Adversarial Imitation Learning

2021-06-30 · Farzan Memarian, Abolfazl Hashemi, Scott Niekum, Ufuk Topcu

We explore methodologies to improve the robustness of generative adversarial imitation learning (GAIL) algorithms to observation noise. Towards this objective, we study the effect of local Lipschitzness of the discrimina…

Imitation LearningMuJoCo

Local Convergence of Gradient Descent-Ascent for Training Generative Adversarial Networks

2023-05-14 · Evan Becker, Parthe Pandit, Sundeep Rangan, Alyson K. Fletcher

Generative Adversarial Networks (GANs) are a popular formulation to train generative models for complex high dimensional data. The standard method for training GANs involves a gradient descent-ascent (GDA) procedure on a…