paper-with-me

Papers

QubitHD: A Stochastic Acceleration Method for HD Computing-Based Machine Learning

2019-11-27 · Samuel Bosch, Alexander Sanchez de la Cerda, Mohsen Imani, Tajana Simunic Rosing, Giovanni De Micheli

Machine Learning algorithms based on Brain-inspired Hyperdimensional(HD) computing imitate cognition by exploiting statistical properties of high-dimensional vector spaces. It is a promising solution for achieving high energy efficiency in different machine learning tasks, such as classification, semi-supervised learning, and clustering. A weakness of existing HD computing-based ML algorithms is the fact that they have to be binarized to achieve very high energy efficiency. At the same time, binarized models reach lower classification accuracies. To solve the problem of the trade-off between energy efficiency and classification accuracy, we propose the QubitHD algorithm. It stochastically binarizes HD-based algorithms, while maintaining comparable classification accuracies to their non-binarized counterparts. The FPGA implementation of QubitHD provides a 65% improvement in terms of energy efficiency, and a 95% improvement in terms of training time, as compared to state-of-the-art HD-based ML algorithms. It also outperforms state-of-the-art low-cost classifiers (such as Binarized Neural Networks) in terms of speed and energy efficiency by an order of magnitude during training and inference.

📄 PDF Abstract BibTeX arXiv:1911.12446

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine LearningClassificationClusteringGeneral Classification

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Memristor-based Synaptic Sampling Machines

2018-08-02 · Irina Dolzhikova, Khaled Salama, Vipin Kizheppatt, Alex Pappachen James

Synaptic Sampling Machine (SSM) is a type of neural network model that considers biological unreliability of the synapses. We propose the circuit design of the SSM neural network which is realized through the memristive-…

Edge-computing

Sustainable Transformer Neural Network Acceleration with Stochastic Photonic Computing

2026-04-10 · S. Afifi, O. Alo, I. Thakkar, S. Pasricha arxiv

Transformers achieve state-of-the-art performance in natural language processing, vision, and scientific computing, but demand high computation and memory. To address these challenges, we present ASTRA, the first silicon…

ASCEND: Accurate yet Efficient End-to-End Stochastic Computing Acceleration of Vision Transformer

2024-02-20 · Tong Xie, Yixuan Hu, Renjie Wei, Meng Li 외

Stochastic computing (SC) has emerged as a promising computing paradigm for neural acceleration. However, how to accelerate the state-of-the-art Vision Transformer (ViT) with SC remains unclear. Unlike convolutional neur…

Design Challenges of Neural Network Acceleration Using Stochastic Computing

2020-06-08 · Alireza Khadem

The enormous and ever-increasing complexity of state-of-the-art neural networks (NNs) has impeded the deployment of deep learning on resource-limited devices such as the Internet of Things (IoTs). Stochastic computing ex…

Stochastic Proximal Gradient Descent with Acceleration Techniques

2014-12-01 · NeurIPS 2014 12 · Atsushi Nitanda

Proximal gradient descent (PGD) and stochastic proximal gradient descent (SPGD) are popular methods for solving regularized risk minimization problems in machine learning and statistics. In this paper, we propose and ana…