Fusing Foveal Fixations Using Linear Retinal Transformations and Bayesian Experimental Design
Humans (and many vertebrates) face the problem of fusing together multiple fixations of a scene in order to obtain a representation of the whole, where each fixation uses a high-resolution fovea and decreasing resolution in the periphery. In this paper we explicitly represent the retinal transformation of a fixation as a linear downsampling of a high-resolution latent image of the scene, exploiting the known geometry. This linear transformation allows us to carry out exact inference for the latent variables in factor analysis (FA) and mixtures of FA models of the scene. Further, this allows us to formulate and solve the choice of "where to look next" as a Bayesian experimental design problem using the Expected Information Gain criterion. Experiments on the Frey faces and MNIST datasets demonstrate the effectiveness of our models.
Code (0)
등록된 구현이 없습니다.
Tasks
Experimental DesignMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Emergence of foveal image sampling from learning to attend in visual scenes
We describe a neural attention model with a learnable retinal sampling lattice. The model is trained on a visual search task requiring the classification of an object embedded in a visual scene amidst background distract…
General ClassificationThickness Mapping of Eleven Retinal Layers in Normal Eyes Using Spectral Domain Optical Coherence Tomography
Purpose. This study was conducted to determine the thickness map of eleven retinal layers in normal subjects by spectral domain optical coherence tomography (SD-OCT) and evaluate their association with sex and age. Metho…
Learning to combine foveal glimpses with a third-order Boltzmann machine
We describe a model based on a Boltzmann machine with third-order connections that can learn how to accumulate information about a shape over several fixations. The model uses a retina that only has enough high resolutio…
General Classificationimage-classificationImage ClassificationEffect of fixation target on the contrast sensitivity in the foveal and parafoveal area
Purpose To determine the influence on the contrast sensitivity when the stimulus contains a fixation target in two retinal locations, foveal and parafoveal. Methods Four young adults with 0.0 logMar acuity particip…
SensitivityLook Twice: A Generalist Computational Model Predicts Return Fixations across Tasks and Species
Primates constantly explore their surroundings via saccadic eye movements that bring different parts of an image into high resolution. In addition to exploring new regions in the visual field, primates also make frequent…
Object Recognition