paper-with-me

Papers

Spatial and Colour Opponency in Anatomically Constrained Deep Networks

2019-10-14 · Ethan Harris, Daniela Mihai, Jonathon Hare

Colour vision has long fascinated scientists, who have sought to understand both the physiology of the mechanics of colour vision and the psychophysics of colour perception. We consider representations of colour in anatomically constrained convolutional deep neural networks. Following ideas from neuroscience, we classify cells in early layers into groups relating to their spectral and spatial functionality. We show the emergence of single and double opponent cells in our networks and characterise how the distribution of these cells changes under the constraint of a retinal bottleneck. Our experiments not only open up a new understanding of how deep networks process spatial and colour information, but also provide new tools to help understand the black box of deep learning. The code for all experiments is avaialable at \url{https://github.com/ecs-vlc/opponency}.

📄 PDF Abstract BibTeX arXiv:1910.11086

Code (1)

ecs-vlc/opponency 공식 구현 pytorch

Similar Papers 제목 키워드 기반

How Convolutional Neural Network Architecture Biases Learned Opponency and Colour Tuning

2020-10-06 · Ethan Harris, Daniela Mihai, Jonathon Hare

Recent work suggests that changing Convolutional Neural Network (CNN) architecture by introducing a bottleneck in the second layer can yield changes in learned function. To understand this relationship fully requires a w…

Anatomically Constrained ResNets Exhibit Opponent Receptive Fields; So What?

2020-10-09 · NeurIPS Workshop SVRHM 2020 12 · Ethan Harris, Daniela Mihai, Jonathon Hare

Primate visual systems are well known to exhibit varying degrees of bottlenecks in the early visual pathway. Recent works have shown that the presence of a bottleneck between 'retinal' and 'ventral' parts of artificial m…

Colour Constancy: Biologically-inspired Contrast Variant Pooling Mechanism

2017-11-29 · Arash Akbarinia, Raquel Gil Rodríguez, C. Alejandro Parraga

Pooling is a ubiquitous operation in image processing algorithms that allows for higher-level processes to collect relevant low-level features from a region of interest. Currently, max-pooling is one of the most commonly…

Extending Phase Mechanism to Differential Motion Opponency for Motion Pop-out

2009-12-01 · NeurIPS 2009 12 · Yicong Meng, Bertram E. Shi

We extend the concept of phase tuning, a ubiquitous mechanism in sensory neurons including motion and disparity detection neurons, to the motion contrast detection. We demonstrate that motion contrast can be detected by…

Is It a Plausible Colour? UCapsNet for Image Colourisation

2020-12-04 · Rita Pucci, Christian Micheloni, Gian Luca Foresti, Niki Martinel

Human beings can imagine the colours of a grayscale image with no particular effort thanks to their ability of semantic feature extraction. Can an autonomous system achieve that? Can it hallucinate plausible and vibrant …

Self-Supervised Learning