paper-with-me

홈 › Papers

Improving Convolutional Networks With Self-Calibrated Convolutions

2020-06-01 · CVPR 2020 6 · Jiang-Jiang Liu, Qibin Hou, Ming-Ming Cheng, Changhu Wang, Jiashi Feng

Recent advances on CNNs are mostly devoted to designing more complex architectures to enhance their representation learning capacity. In this paper, we consider how to improve the basic convolutional feature transformation process of CNNs without tuning the model architectures. To this end, we present a novel self-calibrated convolutions that explicitly expand fields-of-view of each convolutional layers through internal communications and hence enrich the output features. In particular, unlike the standard convolutions that fuse spatial and channel-wise information using small kernels (e.g., 3x3), self-calibrated convolutions adaptively build long-range spatial and inter-channel dependencies around each spatial location through a novel self-calibration operation. Thus, it can help CNNs generate more discriminative representations by explicitly incorporating richer information. Our self-calibrated convolution design is simple and generic, and can be easily applied to augment standard convolutional layers without introducing extra parameters and complexity. Extensive experiments demonstrate that when applying self-calibrated convolutions into different backbones, our networks can significantly improve the baseline models in a variety of vision tasks, including image recognition, object detection, instance segmentation, and keypoint detection, with no need to change the network architectures. We hope this work could provide a promising way for future research in designing novel convolutional feature transformations for improving convolutional networks. Code is available on the project page.

📄 PDF Abstract BibTeX

Code (3)

MCG-NKU/SCNet 공식 구현 pytorch
open-mmlab/mmpose pytorch
osmr/imgclsmob mxnet

Tasks

Instance SegmentationKeypoint Detectionobject-detectionObject DetectionRepresentation LearningSemantic Segmentation

Methods 이 논문이 사용한 방법론

Self-Calibrated Convolutions Liu et al. presented self-calibrated convolution as a means to enlarge the receptive field at each spatial location. Self-calibrated convolution is used together with a…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Super-Resolution Image Reconstruction Based on Self-Calibrated Convolutional GAN

2021-06-10 · Yibo Guo, Haidi Wang, Yiming Fan, Shunyao Li 외

With the effective application of deep learning in computer vision, breakthroughs have been made in the research of super-resolution images reconstruction. However, many researches have pointed out that the insufficiency…

Image ReconstructionSSIMSuper-Resolution

Self-calibrated convolution towards glioma segmentation

2024-02-07 · Felipe C. R. Salvagnini, Gerson O. Barbosa, Alexandre X. Falcao, Cid A. N. Santos

Accurate brain tumor segmentation in the early stages of the disease is crucial for the treatment's effectiveness, avoiding exhaustive visual inspection of a qualified specialist on 3D MR brain images of multiple protoco…

Brain Tumor SegmentationSegmentationTumor Segmentation

Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models

2021-06-10 · ACL 2021 5 · Tyler A. Chang, Yifan Xu, Weijian Xu, Zhuowen Tu

In this paper, we detail the relationship between convolutions and self-attention in natural language tasks. We show that relative position embeddings in self-attention layers are equivalent to recently-proposed dynamic …

Language ModelingLanguage ModellingPosition

Convolution kernel adaptation to calibrated fisheye

2024-02-02 · Bruno Berenguel-Baeta, Maria Santos-Villafranca, Jesus Bermudez-Cameo, Alejandro Perez-Yus 외

Convolution kernels are the basic structural component of convolutional neural networks (CNNs). In the last years there has been a growing interest in fisheye cameras for many applications. However, the radially symmetri…

Depth EstimationSemantic Segmentation

Self-Attentive Sequential Recommendation with Cheap Causal Convolutions

2022-11-02 · Jiayi Chen, Wen Wu, Liye Shi, Yu Ji 외

Sequential Recommendation is a prominent topic in current research, which uses user behavior sequence as an input to predict future behavior. By assessing the correlation strength of historical behavior through the dot p…

Sequential Recommendation