paper-with-me

홈 › Papers

Adaptive whitening with fast gain modulation and slow synaptic plasticity

2023-08-25 · NeurIPS 2023 11 · Lyndon R. Duong, Eero P. Simoncelli, Dmitri B. Chklovskii, David Lipshutz

Neurons in early sensory areas rapidly adapt to changing sensory statistics, both by normalizing the variance of their individual responses and by reducing correlations between their responses. Together, these transformations may be viewed as an adaptive form of statistical whitening. Existing mechanistic models of adaptive whitening exclusively use either synaptic plasticity or gain modulation as the biological substrate for adaptation; however, on their own, each of these models has significant limitations. In this work, we unify these approaches in a normative multi-timescale mechanistic model that adaptively whitens its responses with complementary computational roles for synaptic plasticity and gain modulation. Gains are modified on a fast timescale to adapt to the current statistical context, whereas synapses are modified on a slow timescale to match structural properties of the input statistics that are invariant across contexts. Our model is derived from a novel multi-timescale whitening objective that factorizes the inverse whitening matrix into basis vectors, which correspond to synaptic weights, and a diagonal matrix, which corresponds to neuronal gains. We test our model on synthetic and natural datasets and find that the synapses learn optimal configurations over long timescales that enable adaptive whitening on short timescales using gain modulation.

📄 PDF Abstract BibTeX arXiv:2308.13633

Code (1)

lyndond/multi_timescale_whitening 공식 구현

Similar Papers 제목 키워드 기반

Adaptive whitening in neural populations with gain-modulating interneurons

2023-01-27 · Lyndon R. Duong, David Lipshutz, David J. Heeger, Dmitri B. Chklovskii 외

Statistical whitening transformations play a fundamental role in many computational systems, and may also play an important role in biological sensory systems. Existing neural circuit models of adaptive whitening operate…

Gradient-based Training of Slow Feature Analysis by Differentiable Approximate Whitening

2018-08-27 · Merlin Schüler, Hlynur Davíð Hlynsson, Laurenz Wiskott

We propose Power Slow Feature Analysis, a gradient-based method to extract temporally slow features from a high-dimensional input stream that varies on a faster time-scale, as a variant of Slow Feature Analysis (SFA) tha…

What Really Matters in Matrix-Whitening Optimizers?

2025-10-28 · Kevin Frans, Pieter Abbeel, Sergey Levine arxiv

A range of recent optimizers have emerged that approximate the same "matrix-whitening" transformation in various ways. In this work, we systematically deconstruct such optimizers, aiming to disentangle the key components…

Distributed Blind Source Separation based on FastICA

2024-10-24 · Cem Ates Musluoglu, Alexander Bertrand

With the emergence of wireless sensor networks (WSNs), many traditional signal processing tasks are required to be computed in a distributed fashion, without transmissions of the raw data to a centralized processing unit…

blind source separation

Cluster Index Modulation for Reconfigurable Intelligent Surface-Assisted mmWave Massive MIMO

2023-02-08 · Mahmoud Raeisi, Asil Koc, Ibrahim Yildirim, Ertugrul Basar 외

In this paper, we propose a transmission mechanism for a reconfigurable intelligent surface (RIS)-assisted millimeter wave (mmWave) system based on cluster index modulation (CIM), named best-gain optimized cluster select…

Diversity