paper-with-me

홈 › Papers

XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks

2016-03-16 · Mohammad Rastegari, Vicente Ordonez, Joseph Redmon, Ali Farhadi

We propose two efficient approximations to standard convolutional neural networks: Binary-Weight-Networks and XNOR-Networks. In Binary-Weight-Networks, the filters are approximated with binary values resulting in 32x memory saving. In XNOR-Networks, both the filters and the input to convolutional layers are binary. XNOR-Networks approximate convolutions using primarily binary operations. This results in 58x faster convolutional operations and 32x memory savings. XNOR-Nets offer the possibility of running state-of-the-art networks on CPUs (rather than GPUs) in real-time. Our binary networks are simple, accurate, efficient, and work on challenging visual tasks. We evaluate our approach on the ImageNet classification task. The classification accuracy with a Binary-Weight-Network version of AlexNet is only 2.9% less than the full-precision AlexNet (in top-1 measure). We compare our method with recent network binarization methods, BinaryConnect and BinaryNets, and outperform these methods by large margins on ImageNet, more than 16% in top-1 accuracy.

📄 PDF Abstract BibTeX arXiv:1603.05279

Code (20)

1adrianb/binary-networks-pytorch pytorch
Akaza994/Binary-Quantization pytorch
Enderdead/Pytorch_Quantize_impls pytorch
Jopyth/BMXNet tf
OneRaynyDay/xnornet
XinDongol/BENN-PyTorch pytorch
brycexu/MR-Residual-Net pytorch
cooooorn/pytorch-xnor-net pytorch
eghouti/BinaryConnect pytorch
gaochang-bjtu/1-bit-fqt pytorch
himewel/yolowell
hpi-xnor/BMXNet mxnet
hpi-xnor/BMXNet-v2 mxnet
hwang595/cuttlefish jax
kai-liu001/bimacosr pytorch
lucamocerino/Binary-Neural-Networks-PyTorch-1.0 pytorch
lzj994/Binary-Quantization pytorch
mazc2121/boolean-nets tf
pminhtam/xnor_conv_pytorch_extension pytorch
ryuz/BinaryBrain pytorch

Tasks

BinarizationClassification with Binary Neural NetworkGeneral Classification

Methods 이 논문이 사용한 방법론

1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Local Response Normalization Local Response Normalization is a normalization layer that implements the idea of lateral inhibition. Lateral inhibition is a concept in neurobiology that refers to the…
Grouped Convolution A Grouped Convolution uses a group of convolutions - multiple kernels per layer - resulting in multiple channel outputs per layer. This leads to wider networks helping a…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…

Similar Papers 제목 키워드 기반

XNOR-Net++: Improved Binary Neural Networks

2019-09-30 · Adrian Bulat, Georgios Tzimiropoulos

This paper proposes an improved training algorithm for binary neural networks in which both weights and activations are binary numbers. A key but fairly overlooked feature of the current state-of-the-art method of XNOR-N…

BinarizationClassification with Binary Neural NetworkImage ClassificationNeural Network Compression+1

XNORBIN: A 95 TOp/s/W Hardware Accelerator for Binary Convolutional Neural Networks

2018-03-05 · Andrawes Al Bahou, Geethan Karunaratne, Renzo Andri, Lukas Cavigelli 외

Deploying state-of-the-art CNNs requires power-hungry processors and off-chip memory. This precludes the implementation of CNNs in low-power embedded systems. Recent research shows CNNs sustain extreme quantization, bina…

Quantization

Learning Channel-Wise Interactions for Binary Convolutional Neural Networks

2019-06-01 · CVPR 2019 6 · Ziwei Wang, Jiwen Lu, Chenxin Tao, Jie Zhou 외

In this paper, we propose a channel-wise interaction based binary convolutional neural network learning method (CI-BCNN) for efficient inference. Conventional methods apply xnor and bitcount operations in binary convolut…

QuantizationReinforcement Learning

Exploration of Hardware Acceleration Methods for an XNOR Traffic Signs Classifier

2021-04-06 · Dominika Przewlocka-Rus, Marcin Kowalczyk, Tomasz Kryjak

Deep learning algorithms are a key component of many state-of-the-art vision systems, especially as Convolutional Neural Networks (CNN) outperform most solutions in the sense of accuracy. To apply such algorithms in real…

Optimization of XNOR Convolution for Binary Convolutional Neural Networks on GPU

2020-07-28 · Mete Can Kaya, Alperen İnci, Alptekin Temizel

Binary convolutional networks have lower computational load and lower memory foot-print compared to their full-precision counterparts. So, they are a feasible alternative for the deployment of computer vision application…

GPU