Stationary-State Statistics of a Binary Neural Network Model with Quenched Disorder
We study the statistical properties of the stationary firing-rate states of a neural network model with quenched disorder. The model has arbitrary size, discrete-time evolution equations and binary firing rates, while the topology and the strength of the synaptic connections are randomly generated from known, generally arbitrary, probability distributions. We derived semi-analytical expressions of the occurrence probability of the stationary states and the mean multistability diagram of the model, in terms of the distribution of the synaptic connections and of the external stimuli to the network. Our calculations rely on the probability distribution of the bifurcation points of the stationary states with respect to the external stimuli, which can be calculated in terms of the permanent of special matrices, according to extreme value theory. While our semi-analytical expressions are exact for any size of the network and for any distribution of the synaptic connections, we also specialized our calculations to the case of statistically-homogeneous multi-population networks. In the specific case of this network topology, we calculated analytically the permanent, obtaining a compact formula that outperforms of several orders of magnitude the Balasubramanian-Bax-Franklin-Glynn algorithm. To conclude, by applying the Fisher-Tippett-Gnedenko theorem, we derived asymptotic expressions of the stationary-state statistics of multi-population networks in the large-network-size limit, in terms of the Gumbel (double exponential) distribution. We also provide a Python implementation of our formulas and some examples of the results generated by the code.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Birth-death processes with quenched uncertainty and intrinsic noise
The dynamics of populations is frequently subject to intrinsic noise. At the same time unknown interaction networks or rate constants can present quenched uncertainty. Existing approaches often involve repeated sampling …
Statistics of correlations in nonlinear recurrent neural networks
The statistics of correlations are central quantities characterizing the collective dynamics of recurrent neural networks. We derive exact expressions for the statistics of correlations of nonlinear recurrent networks in…
A Sharp Universality Dichotomy for the Free Energy of Spherical Spin Glasses
We study the free energy for pure and mixed spherical $p$-spin models with i.i.d.\ disorder. In the mixed case, each $p$-interaction layer is assumed either to have regularly varying tails with exponent $α_p$ or to satis…
Striated Populations in Disordered Environments with Advection
Growth in static and controlled environments such as a Petri dish can be used to study the spatial population dynamics of microorganisms. However, natural populations such as marine microbes experience fluid advection an…
Nonequilbrium physics of generative diffusion models
Generative diffusion models apply the concept of Langevin dynamics in physics to machine leaning, attracting a lot of interests from engineering, statistics and physics, but a complete picture about inherent mechanisms i…