paper-with-me

Papers

CompConv: A Compact Convolution Module for Efficient Feature Learning

2021-06-19 · Chen Zhang, Yinghao Xu, Yujun Shen

Convolutional Neural Networks (CNNs) have achieved remarkable success in various computer vision tasks but rely on tremendous computational cost. To solve this problem, existing approaches either compress well-trained large-scale models or learn lightweight models with carefully designed network structures. In this work, we make a close study of the convolution operator, which is the basic unit used in CNNs, to reduce its computing load. In particular, we propose a compact convolution module, called CompConv, to facilitate efficient feature learning. With the divide-and-conquer strategy, CompConv is able to save a great many computations as well as parameters to produce a certain dimensional feature map. Furthermore, CompConv discreetly integrates the input features into the outputs to efficiently inherit the input information. More importantly, the novel CompConv is a plug-and-play module that can be directly applied to modern CNN structures to replace the vanilla convolution layers without further effort. Extensive experimental results suggest that CompConv can adequately compress the benchmark CNN structures yet barely sacrifice the performance, surpassing other competitors.

📄 PDF Abstract BibTeX arXiv:2106.10486

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Merging and Evolution: Improving Convolutional Neural Networks for Mobile Applications

2018-03-24 · Zheng Qin, Zhaoning Zhang, Shiqing Zhang, Hao Yu 외

Compact neural networks are inclined to exploit "sparsely-connected" convolutions such as depthwise convolution and group convolution for employment in mobile applications. Compared with standard "fully-connected" convol…

Interleaved Block-based Learned Image Compression with Feature Enhancement and Quantization Error Compensation

2025-02-21 · Shiqi Jiang, Hui Yuan, Shuai Li, Raouf Hamzaoui 외

In recent years, learned image compression (LIC) methods have achieved significant performance improvements. However, obtaining a more compact latent representation and reducing the impact of quantization errors remain k…

Image CompressionMS-SSIMQuantizationSSIM

ULSAM: Ultra-Lightweight Subspace Attention Module for Compact Convolutional Neural Networks

2020-06-26 · Rajat Saini, Nandan Kumar Jha, Bedanta Das, Sparsh Mittal 외

The capability of the self-attention mechanism to model the long-range dependencies has catapulted its deployment in vision models. Unlike convolution operators, self-attention offers infinite receptive field and enables…

Fine-Grained Image ClassificationGeneral Classificationimage-classificationImage Classification

A Compact Hybrid Convolution--Frequency State Space Network for Learned Image Compression

2025-11-25 · Haodong Pan, Hao Wei, Yusong Wang, Nanning Zheng 외 arxiv

Learned image compression (LIC) has recently benefited from Transformer- and state space models (SSM)- based backbones for modeling long-range dependencies. However, the former typically incurs quadratic complexity, wher…

Image Compression

Feature Aggregation Network for Video Face Recognition

2019-05-06 · Zhaoxiang Liu, Huan Hu, Jinqiang Bai, Shaohua Li 외

This paper aims to learn a compact representation of a video for video face recognition task. We make the following contributions: first, we propose a meta attention-based aggregation scheme which adaptively and fine-gra…

Face Recognition