paper-with-me

Papers

Image Segmentation via Divisive Normalization: dealing with environmental diversity

2024-07-25 · Pablo Hernández-Cámara, Jorge Vila-Tomás, Paula Dauden-Oliver, Nuria Alabau-Bosque, Valero Laparra, Jesús Malo

Autonomous driving is a challenging scenario for image segmentation due to the presence of uncontrolled environmental conditions and the eventually catastrophic consequences of failures. Previous work suggested that a biologically motivated computation, the so-called Divisive Normalization, could be useful to deal with image variability, but its effects have not been systematically studied over different data sources and environmental factors. Here we put segmentation U-nets augmented with Divisive Normalization to work far from training conditions to find where this adaptation is more critical. We categorize the scenes according to their radiance level and dynamic range (day/night), and according to their achromatic/chromatic contrasts. We also consider video game (synthetic) images to broaden the range of environments. We check the performance in the extreme percentiles of such categorization. Then, we push the limits further by artificially modifying the images in perceptually/environmentally relevant dimensions: luminance, contrasts and spectral radiance. Results show that neural networks with Divisive Normalization get better results in all the scenarios and their performance remains more stable with regard to the considered environmental factors and nature of the source. Finally, we explain the improvements in segmentation performance in two ways: (1) by quantifying the invariance of the responses that incorporate Divisive Normalization, and (2) by illustrating the adaptive nonlinearity of the different layers that depends on the local activity.

📄 PDF Abstract BibTeX arXiv:2407.17829

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingDiversityImage SegmentationSegmentationSemantic Segmentation

Similar Papers 제목 키워드 기반

Neural Networks with Divisive normalization for image segmentation with application in cityscapes dataset

2022-03-25 · Pablo Hernández-Cámara, Valero Laparra, Jesús Malo

One of the key problems in computer vision is adaptation: models are too rigid to follow the variability of the inputs. The canonical computation that explains adaptation in sensory neuroscience is divisive normalization…

Image SegmentationSegmentationSemantic Segmentation

Normalizing the Normalizers: Comparing and Extending Network Normalization Schemes

2016-11-14 · Mengye Ren, Renjie Liao, Raquel Urtasun, Fabian H. Sinz 외

Normalization techniques have only recently begun to be exploited in supervised learning tasks. Batch normalization exploits mini-batch statistics to normalize the activations. This was shown to speed up training and res…

image-classificationImage ClassificationLanguage ModelingLanguage Modelling+1

Divisive Feature Normalization Improves Image Recognition Performance in AlexNet

2021-09-29 · ICLR 2022 4 · Michelle Miller, SueYeon Chung, Kenneth D. Miller

Local divisive normalization provides a phenomenological description of many nonlinear response properties of neurons across visual cortical areas. To gain insight into the utility of this operation, we studied the effec…

Cortical Divisive Normalization from Wilson-Cowan Neural Dynamics

2019-06-19 · J. Malo, J. J. Esteve-Taboada, M. Bertalmío

Divisive Normalization and the Wilson-Cowan equations are influential models of neural interaction and saturation [Carandini and Heeger Nat.Rev.Neurosci. 2012; Wilson and Cowan Kybernetik 1973]. However, they have not be…

Relation

Appropriate kernels for Divisive Normalization explained by Wilson-Cowan equations

2018-04-16

The interaction between wavelet-like sensors in Divisive Normalization is classically described through Gaussian kernels that decay with spatial distance, angular distance and frequency distance. However, simultaneous ex…