Neural Networks for Efficient Bayesian Decoding of Natural Images from Retinal Neurons
Decoding sensory stimuli from neural signals can be used to reveal how we sense our physical environment, and is valuable for the design of brain-machine interfaces. However, existing linear techniques for neural decoding may not fully reveal or exploit the fidelity of the neural signal. Here we develop a new approximate Bayesian method for decoding natural images from the spiking activity of populations of retinal ganglion cells (RGCs). We sidestep known computational challenges with Bayesian inference by exploiting artificial neural networks developed for computer vision, enabling fast nonlinear decoding that incorporates natural scene statistics implicitly. We use a decoder architecture that first linearly reconstructs an image from RGC spikes, then applies a convolutional autoencoder to enhance the image. The resulting decoder, trained on natural images and simulated neural responses, significantly outperforms linear decoding, as well as simple point-wise nonlinear decoding. These results provide a tool for the assessment and optimization of retinal prosthesis technologies, and reveal that the retina may provide a more accurate representation of the visual scene than previously appreciated.
Code (1)
Tasks
Bayesian InferenceDecoderMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Unsupervised learning on spontaneous retinal activity leads to efficient neural representation geometry
Prior to the onset of vision, neurons in the developing mammalian retina spontaneously fire in correlated activity patterns known as retinal waves. Experimental evidence suggests that retinal waves strongly influence the…
Contrastive Learningimage-classificationImage ClassificationNoise-Robust Modes of the Retinal Population Code have the Geometry of "Ridges" and Correspond with Neuronal Communities
An appealing new principle for neural population codes is that correlations among neurons organize neural activity patterns into a discrete set of clusters, which can each be viewed as a noise-robust population "codeword…
From Random to Regular: Variation in the Patterning of Retinal Mosaics
The various types of retinal neurons are each positioned at their respective depths within the retina where they are believed to be assembled as orderly mosaics, in which like-type neurons minimize proximity to one anoth…
DescriptiveDiagnosticMisconceptionsMachine Learning Method for Functional Assessment of Retinal Models
Challenges in the field of retinal prostheses motivate the development of retinal models to accurately simulate Retinal Ganglion Cells (RGCs) responses. The goal of retinal prostheses is to enable blind individuals to so…
BIG-bench Machine LearningBaseline-corrected space-by-time non-negative matrix factorization for decoding single trial population spike trains
Activity of populations of sensory neurons carries stimulus information in both the temporal and the spatial dimensions. This poses the question of how to compactly represent all the information that the population codes…
Tensor Decomposition