paper-with-me

Papers

An Optical XNOR-Bitcount Based Accelerator for Efficient Inference of Binary Neural Networks

2023-02-03 · Sairam Sri Vatsavai, Venkata Sai Praneeth Karempudi, Ishan Thakkar

Binary Neural Networks (BNNs) are increasingly preferred over full-precision Convolutional Neural Networks(CNNs) to reduce the memory and computational requirements of inference processing with minimal accuracy drop. BNNs convert CNN model parameters to 1-bit precision, allowing inference of BNNs to be processed with simple XNOR and bitcount operations. This makes BNNs amenable to hardware acceleration. Several photonic integrated circuits (PICs) based BNN accelerators have been proposed. Although these accelerators provide remarkably higher throughput and energy efficiency than their electronic counterparts, the utilized XNOR and bitcount circuits in these accelerators need to be further enhanced to improve their area, energy efficiency, and throughput. This paper aims to fulfill this need. For that, we invent a single-MRR-based optical XNOR gate (OXG). Moreover, we present a novel design of bitcount circuit which we refer to as Photo-Charge Accumulator (PCA). We employ multiple OXGs in a cascaded manner using dense wavelength division multiplexing (DWDM) and connect them to the PCA, to forge a novel Optical XNOR-Bitcount based Binary Neural Network Accelerator (OXBNN). Our evaluation for the inference of four modern BNNs indicates that OXBNN provides improvements of up to 62x and 7.6x in frames-per-second (FPS) and FPS/W (energy efficiency), respectively, on geometric mean over two PIC-based BNN accelerators from prior work. We developed a transaction-level, event-driven python-based simulator for evaluation of accelerators (https://github.com/uky-UCAT/B_ONN_SIM).

📄 PDF Abstract BibTeX arXiv:2302.06405

Code (1)

uky-UCAT/B_ONN_SIM 공식 구현

Methods 이 논문이 사용한 방법론

PCA Principle Components Analysis (PCA) is an unsupervised method primary used for dimensionality reduction within machine learning. PCA is calculated via a singular value…

Similar Papers 제목 키워드 기반

Learning Channel-Wise Interactions for Binary Convolutional Neural Networks

2019-06-01 · CVPR 2019 6 · Ziwei Wang, Jiwen Lu, Chenxin Tao, Jie Zhou 외

In this paper, we propose a channel-wise interaction based binary convolutional neural network learning method (CI-BCNN) for efficient inference. Conventional methods apply xnor and bitcount operations in binary convolut…

QuantizationReinforcement Learning

XNORBIN: A 95 TOp/s/W Hardware Accelerator for Binary Convolutional Neural Networks

2018-03-05 · Andrawes Al Bahou, Geethan Karunaratne, Renzo Andri, Lukas Cavigelli 외

Deploying state-of-the-art CNNs requires power-hungry processors and off-chip memory. This precludes the implementation of CNNs in low-power embedded systems. Recent research shows CNNs sustain extreme quantization, bina…

Quantization

Exploration of Hardware Acceleration Methods for an XNOR Traffic Signs Classifier

2021-04-06 · Dominika Przewlocka-Rus, Marcin Kowalczyk, Tomasz Kryjak

Deep learning algorithms are a key component of many state-of-the-art vision systems, especially as Convolutional Neural Networks (CNN) outperform most solutions in the sense of accuracy. To apply such algorithms in real…

XNOR Neural Engine: a Hardware Accelerator IP for 21.6 fJ/op Binary Neural Network Inference

2018-07-09 · Francesco Conti, Pasquale Davide Schiavone, Luca Benini

Binary Neural Networks (BNNs) are promising to deliver accuracy comparable to conventional deep neural networks at a fraction of the cost in terms of memory and energy. In this paper, we introduce the XNOR Neural Engine …

A Computing Kernel for Network Binarization on PyTorch

2019-11-11 · Xianda Xu, Marco Pedersoli

Deep Neural Networks have now achieved state-of-the-art results in a wide range of tasks including image classification, object detection and so on. However, they are both computation consuming and memory intensive, maki…

BinarizationCPUGPUimage-classification+4