paper-with-me

Papers

RBCN: Rectified Binary Convolutional Networks for Enhancing the Performance of 1-bit DCNNs

2019-08-21 · Chunlei Liu, Wenrui Ding, Xin Xia, Yuan Hu, Baochang Zhang, Jianzhuang Liu, Bohan Zhuang, Guodong Guo

Binarized convolutional neural networks (BCNNs) are widely used to improve memory and computation efficiency of deep convolutional neural networks (DCNNs) for mobile and AI chips based applications. However, current BCNNs are not able to fully explore their corresponding full-precision models, causing a significant performance gap between them. In this paper, we propose rectified binary convolutional networks (RBCNs), towards optimized BCNNs, by combining full-precision kernels and feature maps to rectify the binarization process in a unified framework. In particular, we use a GAN to train the 1-bit binary network with the guidance of its corresponding full-precision model, which significantly improves the performance of BCNNs. The rectified convolutional layers are generic and flexible, and can be easily incorporated into existing DCNNs such as WideResNets and ResNets. Extensive experiments demonstrate the superior performance of the proposed RBCNs over state-of-the-art BCNNs. In particular, our method shows strong generalization on the object tracking task.

📄 PDF Abstract BibTeX arXiv:1908.07748

Code (0)

등록된 구현이 없습니다.

Tasks

BinarizationObject Tracking

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Dogecoin Customer Service Number +1-833-534-1729 설명 없음

Similar Papers 제목 키워드 기반

Denoising-Enhanced Coarse-to-Fine Infrared Small Target Detection with Attention Prior-Guided Knowledge Distillation

2026-06-20 · Houzhang Fang, Ruixuan Huang, Qiuhuan Chen, Xiaolin Wang 외 arxiv

Infrared small target detection (IRSTD) in high-resolution images is crucial for many practical applications, such as surveillance of unmanned aerial vehicles (UAVs) and UAV-based ground monitoring. However, IRSTD remain…

Knowledge DistillationBinary Classification

Structured Convolution Matrices for Energy-efficient Deep learning

2016-06-08 · Rathinakumar Appuswamy, Tapan Nayak, John Arthur, Steven Esser 외

We derive a relationship between network representation in energy-efficient neuromorphic architectures and block Toplitz convolutional matrices. Inspired by this connection, we develop deep convolutional networks using a…

Deep LearningGeneral Classification

Empirical Evaluation of Rectified Activations in Convolutional Network

2015-05-05 · Bing Xu, Naiyan Wang, Tianqi Chen, Mu Li

In this paper we investigate the performance of different types of rectified activation functions in convolutional neural network: standard rectified linear unit (ReLU), leaky rectified linear unit (Leaky ReLU), parametr…

General Classificationimage-classificationImage Classification

Randomized Block Cubic Newton Method

2018-07-01 · ICML 2018 7 · Nikita Doikov, Peter Richtarik, University Edinburgh

We study the problem of minimizing the sum of three convex functions: a differentiable, twice-differentiable and a non-smooth term in a high dimensional setting. To this effect we propose and analyze a randomized bl…

regression

Uncertainty Propagation in Convolutional Neural Networks: Technical Report

2021-02-11 · Christos Tzelepis, Ioannis Patras

In this technical report we study the problem of propagation of uncertainty (in terms of variances of given uni-variate normal random variables) through typical building blocks of a Convolutional Neural Network (CNN). Th…