Reproduction of Lateral Inhibition-Inspired Convolutional Neural Network for Visual Attention and Saliency Detection
In recent years, neural networks have continued to flourish, achieving high efficiency in detecting relevant objects in photos or simply recognizing (classifying) these objects - mainly using CNN networks. Current solutions, however, are far from ideal, because it often turns out that network can be effectively confused with even natural images examples. I suspect that the classification of an object is strongly influenced by the background pixels on which the object is located. In my work, I analyze the above problem using for this purpose saliency maps created by the LICNN network. They are designed to suppress the neurons surrounding the examined object and, consequently, reduce the contribution of background pixels to the classifier predictions. My experiments on the natural and adversarial images datasets show that, indeed, there is a visible correlation between the background and the wrong-classified foreground object. This behavior of the network is not supported by human experience, because, for example, we do not confuse the yellow school bus with the snow plow just because it is on the snowy background.
Code (1)
Tasks
ObjectSaliency DetectionSimilar Papers 제목 키워드 기반
Dilated Convolutions with Lateral Inhibitions for Semantic Image Segmentation
Dilated convolutions are widely used in deep semantic segmentation models as they can enlarge the filters' receptive field without adding additional weights nor sacrificing spatial resolution. However, as dilated convolu…
Image SegmentationSemantic SegmentationBio-inspired learnable divisive normalization for ANNs
In this work we introduce DivNormEI, a novel bio-inspired convolutional network that performs divisive normalization, a canonical cortical computation, along with lateral inhibition and excitation that is tailored for in…
Decoderimage-classificationImage ClassificationObject RecognitionGradient Mask: Lateral Inhibition Mechanism Improves Performance in Artificial Neural Networks
Lateral inhibitory connections have been observed in the cortex of the biological brain, and has been extensively studied in terms of its role in cognitive functions. However, in the vanilla version of backpropagation in…
Data AugmentationTowards Improving the Performance of Pre-Trained Speech Models for Low-Resource Languages Through Lateral Inhibition
With the rise of bidirectional encoder representations from Transformer models in natural language processing, the speech community has adopted some of their development methodologies. Therefore, the Wav2Vec models were …
RACAI at SemEval-2022 Task 11: Complex named entity recognition using a lateral inhibition mechanism
This paper presents RACAI’s system used for the shared task of “Multilingual Complex Named Entity Recognition (MultiCoNER)”, organized as part of the “The 16th International Workshop on Semantic Evaluation (SemEval 2022)…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)