paper-with-me

Papers

RISC-V Based TinyML Accelerator for Depthwise Separable Convolutions in Edge AI

2025-11-26 · Muhammed Yildirim, Ozcan Ozturk arxiv

The increasing demand for on-device intelligence in Edge AI and TinyML applications requires the efficient execution of modern Convolutional Neural Networks (CNNs). While lightweight architectures like MobileNetV2 employ Depthwise Separable Convolutions (DSC) to reduce computational complexity, their multi-stage design introduces a critical performance bottleneck inherent to layer-by-layer execution: the high energy and latency cost of transferring intermediate feature maps to either large on-chip buffers or off-chip DRAM. To address this memory wall, this paper introduces a novel hardware accelerator architecture that utilizes a fused pixel-wise dataflow. Implemented as a Custom Function Unit (CFU) for a RISC-V processor, our architecture eliminates the need for intermediate buffers entirely, reducing the data movement up to 87\% compared to conventional layer-by-layer execution. It computes a single output pixel to completion across all DSC stages-expansion, depthwise convolution, and projection-by streaming data through a tightly-coupled pipeline without writing to memory. Evaluated on a Xilinx Artix-7 FPGA, our design achieves a speedup of up to 59.3x over the baseline software execution on the RISC-V core. Furthermore, ASIC synthesis projects a compact 0.284 mm$^2$ footprint with 910 mW power at 2 GHz in 28 nm, and a 1.20 mm$^2$ footprint with 233 mW power at 300 MHz in 40 nm. This work confirms the feasibility of a zero-buffer dataflow within a TinyML resource envelope, offering a novel and effective strategy for overcoming the memory wall in edge AI accelerators.

📄 PDF Abstract BibTeX arXiv:2511.21232

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

On-Device Crack Segmentation for Edge Structural Health Monitoring

2025-05-12 · Yuxuan Zhang, Ye Xu, Luciano Sebastian Martinez-Rau, Quynh Nguyen Phuong Vu 외

Crack segmentation can play a critical role in Structural Health Monitoring (SHM) by enabling accurate identification of crack size and location, which allows to monitor structural damages over time. However, deploying d…

Crack SegmentationSegmentationStructural Health Monitoring

Network Decoupling: From Regular to Depthwise Separable Convolutions

2018-08-16 · Jianbo Guo, Yuxi Li, Weiyao Lin, Yurong Chen 외

Depthwise separable convolution has shown great efficiency in network design, but requires time-consuming training procedure with full training-set available. This paper first analyzes the mathematical relationship betwe…

object-detectionObject Detection

Toward Attention-based TinyML: A Heterogeneous Accelerated Architecture and Automated Deployment Flow

2024-08-05 · Philip Wiese, Gamze İslamoğlu, Moritz Scherer, Luka Macan 외

One of the challenges for Tiny Machine Learning (tinyML) is keeping up with the evolution of Machine Learning models from Convolutional Neural Networks to Transformers. We address this by leveraging a heterogeneous archi…

FuSeConv: Fully Separable Convolutions for Fast Inference on Systolic Arrays

2021-05-27 · Surya Selvam, Vinod Ganesan, Pratyush Kumar

Both efficient neural networks and hardware accelerators are being explored to speed up DNN inference on edge devices. For example, MobileNet uses depthwise separable convolution to achieve much lower latency, while syst…

Neural Architecture Search

Depthwise Separable Convolutions for Neural Machine Translation

2017-06-09 · ICLR 2018 1 · Lukasz Kaiser, Aidan N. Gomez, Francois Chollet

Depthwise separable convolutions reduce the number of parameters and computation used in convolutional operations while increasing representational efficiency. They have been shown to be successful in image classificatio…

image-classificationMachine TranslationTranslation