Harnessing and modulating chaos to sample from neural generative models
Chaos is generic in strongly-coupled recurrent networks of model neurons, and thought to be an easily accessible dynamical regime in the brain. While neural chaos is typically seen as an impediment to robust computation, we show how such chaos might play a functional role in allowing the brain to learn and sample from generative models. We construct architectures that combine a classic model of neural chaos either with a canonical generative modeling architecture or with energy-based models of neural memory. We show that these architectures have appealing properties for sampling, including easy biologically-plausible control of sampling rates via overall gain modulation.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
ChaosNet: A Chaos based Artificial Neural Network Architecture for Classification
Inspired by chaotic firing of neurons in the brain, we propose ChaosNet -- a novel chaos based artificial neural network architecture for classification tasks. ChaosNet is built using layers of neurons, each of which is …
ClassificationGeneral ClassificationA Neurochaos Learning Architecture for Genome Classification
There has been empirical evidence of presence of non-linearity and chaos at the level of single neurons in biological neural networks. The properties of chaotic neurons inspires us to employ them in artificial learning s…
ClassificationFeature EngineeringGeneral ClassificationModulating function based algebraic observer coupled with stable output predictor for LTV and sampled-data systems
This paper proposes an algebraic observer-based modulating function approach for linear time-variant systems and a class of nonlinear systems with discrete measurements. The underlying idea lies in constructing an observ…
State EstimationHyperparameter-Free Neurochaos Learning Algorithm for Classification
Neurochaos Learning (NL) is a brain-inspired classification framework that employs chaotic dynamics to extract features from input data and yields state of the art performance on classification tasks. However, NL require…
Revisiting Likelihood-Based Out-of-Distribution Detection by Modeling Representations
Out-of-distribution (OOD) detection is critical for ensuring the reliability of deep learning systems, particularly in safety-critical applications. Likelihood-based deep generative models have historically faced critici…
Out-of-Distribution DetectionOut of Distribution (OOD) Detectionvalid