paper-with-me

홈 › Papers

A trainable monogenic ConvNet layer robust in front of large contrast changes in image classification

2021-09-14 · E. Ulises Moya-Sánchez, Sebastiá Xambo-Descamps, Abraham Sánchez, Sebastián Salazar-Colores, Ulises Cortés

Convolutional Neural Networks (ConvNets) at present achieve remarkable performance in image classification tasks. However, current ConvNets cannot guarantee the capabilities of the mammalian visual systems such as invariance to contrast and illumination changes. Some ideas to overcome the illumination and contrast variations usually have to be tuned manually and tend to fail when tested with other types of data degradation. In this context, we present a new bio-inspired {entry} layer, M6, which detects low-level geometric features (lines, edges, and orientations) which are similar to patterns detected by the V1 visual cortex. This new trainable layer is capable of coping with image classification even with large contrast variations. The explanation for this behavior is the monogenic signal geometry, which represents each pixel value in a 3D space using quaternions, a fact that confers a degree of explainability to the networks. We compare M6 with a conventional convolutional layer (C) and a deterministic quaternion local phase layer (Q9). The experimental setup {is designed to evaluate the robustness} of our M6 enriched ConvNet model and includes three architectures, four datasets, three types of contrast degradation (including non-uniform haze degradations). The numerical results reveal that the models with M6 are the most robust in front of any kind of contrast variations. This amounts to a significant enhancement of the C models, which usually have reasonably good performance only when the same training and test degradation are used, except for the case of maximum degradation. Moreover, the Structural Similarity Index Measure (SSIM) is used to analyze and explain the robustness effect of the M6 feature maps under any kind of contrast degradations.

📄 PDF Abstract BibTeX arXiv:2109.06926

Code (1)

https://gitlab.com/monogenic-layer-m6/monogenic-layer-trainablebio-inspired-cnnlayerforcontrastinvariance 공식 구현 tf

Tasks

image-classificationImage ClassificationSSIM

Similar Papers 제목 키워드 기반

Mono2D: A Trainable Monogenic Layer for Robust Knee Cartilage Segmentation on Out-of-Distribution 2D Ultrasound Data

2025-03-12 · Alvin Kimbowa, Arjun Parmar, Maziar Badii, David Liu 외

Automated knee cartilage segmentation using point-of-care ultrasound devices and deep-learning networks has the potential to enhance the management of knee osteoarthritis. However, segmentation algorithms often struggle …

Domain GeneralizationSegmentationSingle-Source Domain Generalization

Monogenic Wavelet Scattering Network for Texture Image Classification

2022-02-25 · Wai Ho Chak, Naoki Saito

The scattering transform network (STN), which has a similar structure as that of a popular convolutional neural network except its use of predefined convolution filters and a small number of layers, can generates a robus…

Classificationimage-classificationImage Classification

Learning Gating ConvNet for Two-Stream based Methods in Action Recognition

2017-09-12 · Jiagang Zhu, Wei Zou, Zheng Zhu

For the two-stream style methods in action recognition, fusing the two streams' predictions is always by the weighted averaging scheme. This fusion method with fixed weights lacks of pertinence to different action videos…

Action ClassificationAction RecognitionMixture-of-ExpertsMulti-Task Learning+2

Introduction To The Monogenic Signal

2017-03-27 · Christopher P. Bridge

The monogenic signal is an image analysis methodology that was introduced by Felsberg and Sommer in 2001 and has been employed for a variety of purposes in image processing and computer vision research. In particular, it…

Math

Transfer Learning Based on AdaBoost for Feature Selection from Multiple ConvNet Layer Features

2016-02-01 · Jumabek Alikhanov, Myeong Hyeon Ga, Seunghyun Ko, Geun-Sik Jo

Convolutional Networks (ConvNets) are powerful models that learn hierarchies of visual features, which could also be used to obtain image representations for transfer learning. The basic pipeline for transfer learning is…

feature selectionTransfer Learning