paper-with-me

Papers

Learning Channel-Wise Interactions for Binary Convolutional Neural Networks

2019-06-01 · CVPR 2019 6 · Ziwei Wang, Jiwen Lu, Chenxin Tao, Jie Zhou, Qi Tian

In this paper, we propose a channel-wise interaction based binary convolutional neural network learning method (CI-BCNN) for efficient inference. Conventional methods apply xnor and bitcount operations in binary convolution with notable quantization error, which usually obtains inconsistent signs in binary feature maps compared with their full-precision counterpart and leads to significant information loss. In contrast, our CI-BCNN mines the channel-wise interactions, through which prior knowledge is provided to alleviate inconsistency of signs in binary feature maps and preserves the information of input samples during inference. Specifically, we mine the channel-wise interactions by a reinforcement learning model, and impose channel-wise priors on the intermediate feature maps through the interacted bitcount function. Extensive experiments on the CIFAR-10 and ImageNet datasets show that our method outperforms the state-of-the-art binary convolutional neural networks with less computational and storage cost.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

QuantizationReinforcement Learning

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Weight Equalizing Shift Scaler-Coupled Post-training Quantization

2020-08-13 · Jihun Oh, SangJeong Lee, Meejeong Park, Pooni Walagaurav 외

Post-training, layer-wise quantization is preferable because it is free from retraining and is hardware-friendly. Nevertheless, accuracy degradation has occurred when a neural network model has a big difference of per-ou…

Quantization

Learning Deep Bilinear Transformation for Fine-grained Image Representation

2019-11-09 · NeurIPS 2019 12 · Heliang Zheng, Jianlong Fu, Zheng-Jun Zha, Jiebo Luo

Bilinear feature transformation has shown the state-of-the-art performance in learning fine-grained image representations. However, the computational cost to learn pairwise interactions between deep feature channels is p…

Fine-Grained Image Recognition

RecNets: Channel-wise Recurrent Convolutional Neural Networks

2019-05-28 · George Retsinas, Athena Elafrou, Georgios Goumas, Petros Maragos

In this paper, we introduce Channel-wise recurrent convolutional neural networks (RecNets), a family of novel, compact neural network architectures for computer vision tasks inspired by recurrent neural networks (RNNs). …

General Classificationimage-classificationImage Classification

Video Classification with Channel-Separated Convolutional Networks

2019-04-04 · ICCV 2019 10 · Du Tran, Heng Wang, Lorenzo Torresani, Matt Feiszli

Group convolution has been shown to offer great computational savings in various 2D convolutional architectures for image classification. It is natural to ask: 1) if group convolution can help to alleviate the high compu…

Action ClassificationAction RecognitionGeneral Classificationimage-classification+2

ChannelNets: Compact and Efficient Convolutional Neural Networks via Channel-Wise Convolutions

2018-09-05 · NeurIPS 2018 12 · Hongyang Gao, Zhengyang Wang, Shuiwang Ji

Convolutional neural networks (CNNs) have shown great capability of solving various artificial intelligence tasks. However, the increasing model size has raised challenges in employing them in resource-limited applicatio…

General Classification