Encoding Sensory and Motor Patterns as Time-Invariant Trajectories in Recurrent Neural Networks
Much of the information the brain processes and stores is temporal in nature - a spoken word or a handwritten signature, for example, is defined by how it unfolds in time. However, it remains unclear how neural circuits encode complex time-varying patterns. We show that by tuning the weights of a recurrent neural network (RNN), it can recognize and then transcribe spoken digits. The model elucidates how neural dynamics in cortical networks may resolve three fundamental challenges: first, encode multiple time-varying sensory and motor patterns as stable neural trajectories; second, generalize across relevant spatial features; third, identify the same stimuli played at different speeds - we show that this temporal invariance emerges because the recurrent dynamics generate neural trajectories with appropriately modulated angular velocities. Together our results generate testable predictions as to how recurrent networks may use different mechanisms to generalize across the relevant spatial and temporal features of complex time-varying stimuli.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
EEG-based Texture Roughness Classification in Active Tactile Exploration with Invariant Representation Learning Networks
During daily activities, humans use their hands to grasp surrounding objects and perceive sensory information which are also employed for perceptual and motor goals. Multiple cortical brain regions are known to be respon…
EEGElectroencephalogram (EEG)General ClassificationRepresentation LearningUnsupervised Bayesian Ising Approximation for revealing the neural dictionary in songbirds
The problem of deciphering how low-level patterns (action potentials in the brain, amino acids in a protein, etc.) drive high-level biological features (sensorimotor behavior, enzymatic function) represents the central c…
Unifying the Sensory and Motor Components of Sensorimotor Adaptation
Adaptation of visually guided reaching movements in novel visuomotor environments (e.g. wearing prism goggles) comprises not only motor adaptation but also substantial sensory adaptation, corresponding to shifts in the p…
Inhibitory feedback from the motor circuit gates mechanosensory processing in C. elegans
Animals must integrate sensory cues with their current behavioral context to generate a suitable response. How this integration occurs is poorly understood. Previously we developed high throughput methods to probe neural…
Motor control by precisely timed spike patterns
A fundamental problem in neuroscience is to understand how sequences of action potentials ("spikes") encode information about sensory signals and motor outputs. Although traditional theories of neural coding assume that …