paper-with-me

Papers

Appropriate kernels for Divisive Normalization explained by Wilson-Cowan equations

2018-04-16

The interaction between wavelet-like sensors in Divisive Normalization is classically described through Gaussian kernels that decay with spatial distance, angular distance and frequency distance. However, simultaneous explanation of (a) distortion perception in natural image databases and (b) contrast perception of artificial stimuli requires very specific modifications in classical Divisive Normalization. First, the wavelet response has to be high-pass filtered before the Gaussian interaction is applied. Then, distinct weights per subband are also required after the Gaussian interaction. In summary, the classical Gaussian kernel has to be left- and right-multiplied by two extra diagonal matrices. In this paper we provide a lower-level justification for this specific empirical modification required in the Gaussian kernel of Divisive Normalization. Here we assume that the psychophysical behavior described by Divisive Normalization comes from neural interactions following the Wilson-Cowan equations. In particular, we identify the Divisive Normalization response with the stationary regime of a Wilson-Cowan model. From this identification we derive an expression for the Divisive Normalization kernel in terms of the interaction kernel of the Wilson-Cowan equations. It turns out that the Wilson-Cowan kernel is left- and-right multiplied by diagonal matrices with high-pass structure. In conclusion, symmetric Gaussian inhibitory relations between wavelet-like sensors wired in the lower-level Wilson-Cowan model lead to the appropriate non-symmetric kernel that has to be empirically included in Divisive Normalization to explain a wider range of phenomena.

📄 PDF Abstract BibTeX arXiv:1804.05964

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Cortical Divisive Normalization from Wilson-Cowan Neural Dynamics

2019-06-19 · J. Malo, J. J. Esteve-Taboada, M. Bertalmío

Divisive Normalization and the Wilson-Cowan equations are influential models of neural interaction and saturation [Carandini and Heeger Nat.Rev.Neurosci. 2012; Wilson and Cowan Kybernetik 1973]. However, they have not be…

Relation

Visual Information flow in Wilson-Cowan networks

2019-07-30

In this work we study the communication efficiency of a psychophysically-tuned cascade of Wilson-Cowan and Divisive Normalization layers that simulate the retina-V1 pathway. This is the first analysis of Wilson-Cowan net…

Divisive Feature Normalization Improves Image Recognition Performance in AlexNet

2021-09-29 · ICLR 2022 4 · Michelle Miller, SueYeon Chung, Kenneth D. Miller

Local divisive normalization provides a phenomenological description of many nonlinear response properties of neurons across visual cortical areas. To gain insight into the utility of this operation, we studied the effec…

Neural Networks with Divisive normalization for image segmentation with application in cityscapes dataset

2022-03-25 · Pablo Hernández-Cámara, Valero Laparra, Jesús Malo

One of the key problems in computer vision is adaptation: models are too rigid to follow the variability of the inputs. The canonical computation that explains adaptation in sensory neuroscience is divisive normalization…

Image SegmentationSegmentationSemantic Segmentation

Nonperturbative renormalization for the neural network-QFT correspondence

2021-08-03 · Harold Erbin, Vincent Lahoche, Dine Ousmane Samary

In a recent work arXiv:2008.08601, Halverson, Maiti and Stoner proposed a description of neural networks in terms of a Wilsonian effective field theory. The infinite-width limit is mapped to a free field theory, while fi…