paper-with-me

홈 › Papers

Synaptic Weight Distributions Depend on the Geometry of Plasticity

2023-05-30 · Roman Pogodin, Jonathan Cornford, Arna Ghosh, Gauthier Gidel, Guillaume Lajoie, Blake Richards

A growing literature in computational neuroscience leverages gradient descent and learning algorithms that approximate it to study synaptic plasticity in the brain. However, the vast majority of this work ignores a critical underlying assumption: the choice of distance for synaptic changes - i.e. the geometry of synaptic plasticity. Gradient descent assumes that the distance is Euclidean, but many other distances are possible, and there is no reason that biology necessarily uses Euclidean geometry. Here, using the theoretical tools provided by mirror descent, we show that the distribution of synaptic weights will depend on the geometry of synaptic plasticity. We use these results to show that experimentally-observed log-normal weight distributions found in several brain areas are not consistent with standard gradient descent (i.e. a Euclidean geometry), but rather with non-Euclidean distances. Finally, we show that it should be possible to experimentally test for different synaptic geometries by comparing synaptic weight distributions before and after learning. Overall, our work shows that the current paradigm in theoretical work on synaptic plasticity that assumes Euclidean synaptic geometry may be misguided and that it should be possible to experimentally determine the true geometry of synaptic plasticity in the brain.

📄 PDF Abstract BibTeX arXiv:2305.19394

Code (1)

romanpogodin/synaptic-weight-distr 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Test 설명 없음

Similar Papers 제목 키워드 기반

Natural-gradient learning for spiking neurons

2020-11-23 · Elena Kreutzer, Walter M. Senn, Mihai A. Petrovici

In many normative theories of synaptic plasticity, weight updates implicitly depend on the chosen parametrization of the weights. This problem relates, for example, to neuronal morphology: synapses which are functionally…

Synaptic Sampling: A Bayesian Approach to Neural Network Plasticity and Rewiring

2015-12-01 · NeurIPS 2015 12 · David Kappel, Stefan Habenschuss, Robert Legenstein, Wolfgang Maass

We reexamine in this article the conceptual and mathematical framework for understanding the organization of plasticity in spiking neural networks. We propose that inherent stochasticity enables synaptic plasticity to ca…

Synaptic plasticity as Bayesian inference

2014-10-04 · Laurence Aitchison, Jannes Jegminat, Jorge Aurelio Menendez, Jean-Pascal Pfister 외

Learning, especially rapid learning, is critical for survival. However, learning is hard: a large number of synaptic weights must be set based on noisy, often ambiguous, sensory information. In such a high-noise regime, …

Bayesian Inference

Multicoding in neural information transfer suggested by mathematical analysis of the frequency-dependent synaptic plasticity in vivo

2020-01-13

Two elements of neural information processing have primarily been proposed: firing rate and spike timing of neurons. In the case of synaptic plasticity, although spike-timing-dependent plasticity (STDP) depending on pres…

Fluctuation in background synaptic activity controls synaptic plasticity

2021-08-12 · Yuto Takeda, Katsuhiko Hata, Tokio Yamasaki, Masaki Kaneko 외

Synaptic plasticity is vital for learning and memory in the brain. It consists of long-term potentiation (LTP) and long-term depression (LTD). Spike frequency is one of the major components of synaptic plasticity in the …