paper-with-me

Papers

A biologically plausible neural network for Slow Feature Analysis

2020-10-23 · NeurIPS 2020 12 · David Lipshutz, Charlie Windolf, Siavash Golkar, Dmitri B. Chklovskii

Learning latent features from time series data is an important problem in both machine learning and brain function. One approach, called Slow Feature Analysis (SFA), leverages the slowness of many salient features relative to the rapidly varying input signals. Furthermore, when trained on naturalistic stimuli, SFA reproduces interesting properties of cells in the primary visual cortex and hippocampus, suggesting that the brain uses temporal slowness as a computational principle for learning latent features. However, despite the potential relevance of SFA for modeling brain function, there is currently no SFA algorithm with a biologically plausible neural network implementation, by which we mean an algorithm operates in the online setting and can be mapped onto a neural network with local synaptic updates. In this work, starting from an SFA objective, we derive an SFA algorithm, called Bio-SFA, with a biologically plausible neural network implementation. We validate Bio-SFA on naturalistic stimuli.

📄 PDF Abstract BibTeX arXiv:2010.12644

Code (1)

flatironinstitute/bio-sfa 공식 구현

Tasks

HippocampusTime SeriesTime Series Analysis

Similar Papers 제목 키워드 기반

A Dual Fast and Slow Feature Interaction in Biologically Inspired Visual Recognition of Human Action

2015-09-09 · Bardia Yousefi, C. K. Loo

Computational neuroscience studies that have examined human visual system through functional magnetic resonance imaging (fMRI) have identified a model where the mammalian brain pursues two distinct pathways (for recognit…

FormOptical Flow Estimation

Pairing cellular and synaptic dynamics into building blocks of rhythmic neural circuits

2022-11-01 · James Scully, Jassem Bourahmah, David Bloom, Andrey L Shilnikov

The purpose of this paper is trifold -- to serve as an instructive resource and a reference catalog for biologically plausible modeling with i) conductance-based models, coupled with ii) strength-varying slow synapse mod…

Rhythm

Beyond accuracy: generalization properties of bio-plausible temporal credit assignment rules

2022-06-02 · Yuhan Helena Liu, Arna Ghosh, Blake A. Richards, Eric Shea-Brown 외

To unveil how the brain learns, ongoing work seeks biologically-plausible approximations of gradient descent algorithms for training recurrent neural networks (RNNs). Yet, beyond task accuracy, it is unclear if such lear…

Learning Theory

Unlocking the Potential of Similarity Matching: Scalability, Supervision and Pre-training

2023-08-02 · Yanis Bahroun, Shagesh Sridharan, Atithi Acharya, Dmitri B. Chklovskii 외

While effective, the backpropagation (BP) algorithm exhibits limitations in terms of biological plausibility, computational cost, and suitability for online learning. As a result, there has been a growing interest in dev…

Computational Efficiency

Biologically plausible single-layer networks for nonnegative independent component analysis

2020-10-23 · David Lipshutz, Cengiz Pehlevan, Dmitri B. Chklovskii

An important problem in neuroscience is to understand how brains extract relevant signals from mixtures of unknown sources, i.e., perform blind source separation. To model how the brain performs this task, we seek a biol…

blind source separation