paper-with-me

Papers

GMConv: Modulating Effective Receptive Fields for Convolutional Kernels

2023-02-09 · Qi Chen, Chao Li, Jia Ning, Stephen Lin, Kun He

In convolutional neural networks, the convolutions are conventionally performed using a square kernel with a fixed N $\times$ N receptive field (RF). However, what matters most to the network is the effective receptive field (ERF) that indicates the extent with which input pixels contribute to an output pixel. Inspired by the property that ERFs typically exhibit a Gaussian distribution, we propose a Gaussian Mask convolutional kernel (GMConv) in this work. Specifically, GMConv utilizes the Gaussian function to generate a concentric symmetry mask that is placed over the kernel to refine the RF. Our GMConv can directly replace the standard convolutions in existing CNNs and can be easily trained end-to-end by standard back-propagation. We evaluate our approach through extensive experiments on image classification and object detection tasks. Over several tasks and standard base models, our approach compares favorably against the standard convolution. For instance, using GMConv for AlexNet and ResNet-50, the top-1 accuracy on ImageNet classification is boosted by 0.98% and 0.85%, respectively.

📄 PDF Abstract BibTeX arXiv:2302.04544

Code (0)

등록된 구현이 없습니다.

Tasks

image-classificationImage Classificationobject-detectionObject Detection

Methods 이 논문이 사용한 방법론

BASE 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

What are the Receptive, Effective Receptive, and Projective Fields of Neurons in Convolutional Neural Networks?

2017-05-19 · Hung Le, Ali Borji

In this work, we explain in detail how receptive fields, effective receptive fields, and projective fields of neurons in different layers, convolution or pooling, of a Convolutional Neural Network (CNN) are calculated. W…

Understanding the Effective Receptive Field in Deep Convolutional Neural Networks

2017-01-15 · NeurIPS 2016 12 · Wenjie Luo, Yujia Li, Raquel Urtasun, Richard Zemel

We study characteristics of receptive fields of units in deep convolutional networks. The receptive field size is a crucial issue in many visual tasks, as the output must respond to large enough areas in the image to cap…

Translated Skip Connections -- Expanding the Receptive Fields of Fully Convolutional Neural Networks

2022-11-03 · Joshua Bruton, Hairong Wang

The effective receptive field of a fully convolutional neural network is an important consideration when designing an architecture, as it defines the portion of the input visible to each convolutional kernel. We propose …

Image SegmentationSegmentationSelf-Driving CarsSemantic Segmentation

RF-Next: Efficient Receptive Field Search for Convolutional Neural Networks

2022-06-14 · ShangHua Gao, Zhong-Yu Li, Qi Han, Ming-Ming Cheng 외

Temporal/spatial receptive fields of models play an important role in sequential/spatial tasks. Large receptive fields facilitate long-term relations, while small receptive fields help to capture the local details. Exist…

Action SegmentationInstance Segmentationobject-detectionObject Detection+4

Neural Echos: Depthwise Convolutional Filters Replicate Biological Receptive Fields

2024-01-18 · Zahra Babaiee, Peyman M. Kiasari, Daniela Rus, Radu Grosu

In this study, we present evidence suggesting that depthwise convolutional kernels are effectively replicating the structural intricacies of the biological receptive fields observed in the mammalian retina. We provide an…