paper-with-me

Papers

BSC: Block-based Stochastic Computing to Enable Accurate and Efficient TinyML

2021-11-12 · Yuhong Song, Edwin Hsing-Mean Sha, Qingfeng Zhuge, Rui Xu, Yongzhuo Zhang, Bingzhe Li, Lei Yang

Along with the progress of AI democratization, machine learning (ML) has been successfully applied to edge applications, such as smart phones and automated driving. Nowadays, more applications require ML on tiny devices with extremely limited resources, like implantable cardioverter defibrillator (ICD), which is known as TinyML. Unlike ML on the edge, TinyML with a limited energy supply has higher demands on low-power execution. Stochastic computing (SC) using bitstreams for data representation is promising for TinyML since it can perform the fundamental ML operations using simple logical gates, instead of the complicated binary adder and multiplier. However, SC commonly suffers from low accuracy for ML tasks due to low data precision and inaccuracy of arithmetic units. Increasing the length of the bitstream in the existing works can mitigate the precision issue but incur higher latency. In this work, we propose a novel SC architecture, namely Block-based Stochastic Computing (BSC). BSC divides inputs into blocks, such that the latency can be reduced by exploiting high data parallelism. Moreover, optimized arithmetic units and output revision (OUR) scheme are proposed to improve accuracy. On top of it, a global optimization approach is devised to determine the number of blocks, which can make a better latency-power trade-off. Experimental results show that BSC can outperform the existing designs in achieving over 10% higher accuracy on ML tasks and over 6 times power reduction.

📄 PDF Abstract BibTeX arXiv:2111.06686

Code (0)

등록된 구현이 없습니다.

Tasks

global-optimization

Similar Papers 제목 키워드 기반

TinyML Security: Exploring Vulnerabilities in Resource-Constrained Machine Learning Systems

2024-11-11 · Jacob Huckelberry, Yuke Zhang, Allison Sansone, James Mickens 외

Tiny Machine Learning (TinyML) systems, which enable machine learning inference on highly resource-constrained devices, are transforming edge computing but encounter unique security challenges. These devices, restricted …

CPUEdge-computing

Is TinyML Sustainable? Assessing the Environmental Impacts of Machine Learning on Microcontrollers

2023-01-27 · Shvetank Prakash, Matthew Stewart, Colby Banbury, Mark Mazumder 외

The sustained growth of carbon emissions and global waste elicits significant sustainability concerns for our environment's future. The growing Internet of Things (IoT) has the potential to exacerbate this issue. However…

Optimizing LoRa for Edge Computing with TinyML Pipeline for Channel Hopping

2024-12-02 · Marla Grunewald, Mounir Bensalem, Admela Jukan

We propose to integrate long-distance LongRange (LoRa) communication solution for sending the data from IoT to the edge computing system, by taking advantage of its unlicensed nature and the potential for open source imp…

Collaborative FilteringEdge-computing

TinyML: Tools, Applications, Challenges, and Future Research Directions

2023-03-23 · Rakhee Kallimani, Krishna Pai, Prasoon Raghuwanshi, Sridhar Iyer 외

In recent years, Artificial Intelligence (AI) and Machine learning (ML) have gained significant interest from both, industry and academia. Notably, conventional ML techniques require enormous amounts of power to meet the…

Edge-computing

ASCEND: Accurate yet Efficient End-to-End Stochastic Computing Acceleration of Vision Transformer

2024-02-20 · Tong Xie, Yixuan Hu, Renjie Wei, Meng Li 외

Stochastic computing (SC) has emerged as a promising computing paradigm for neural acceleration. However, how to accelerate the state-of-the-art Vision Transformer (ViT) with SC remains unclear. Unlike convolutional neur…