paper-with-me

홈 › Papers

DeltaKWS: A 65nm 36nJ/Decision Bio-inspired Temporal-Sparsity-Aware Digital Keyword Spotting IC with 0.6V Near-Threshold SRAM

2024-05-06 · Qinyu Chen, Kwantae Kim, Chang Gao, Sheng Zhou, Taekwang Jang, Tobi Delbruck, Shih-Chii Liu

This paper introduces DeltaKWS, to the best of our knowledge, the first $\Delta$RNN-enabled fine-grained temporal sparsity-aware KWS IC for voice-controlled devices. The 65 nm prototype chip features a number of techniques to enhance performance, area, and power efficiencies, specifically: 1) a bio-inspired delta-gated recurrent neural network ($\Delta$RNN) classifier leveraging temporal similarities between neighboring feature vectors extracted from input frames and network hidden states, eliminating unnecessary operations and memory accesses; 2) an IIR BPF-based FEx that leverages mixed-precision quantization, low-cost computing structure and channel selection; 3) a 24 kB 0.6 V near-$V_\text{TH}$ weight SRAM that achieves 6.6X lower read power than the foundry-provided SRAM. From chip measurement results, we show that the DeltaKWS achieves an 11/12-class GSCD accuracy of 90.5%/89.5% respectively and energy consumption of 36 nJ/decision in 65 nm CMOS process. At 87% temporal sparsity, computing latency and energy/inference are reduced by 2.4X/3.4X, respectively. The IIR BPF-based FEx, $\Delta$RNN accelerator, and 24 kB near-$V_\text{TH}$ SRAM blocks occupy 0.084 mm$^{2}$, 0.319 mm$^{2}$, and 0.381 mm$^{2}$ respectively (0.78 mm$^{2}$ in total).

📄 PDF Abstract BibTeX arXiv:2405.03905

Code (0)

등록된 구현이 없습니다.

Tasks

channel selectionKeyword SpottingQuantization

Similar Papers 제목 키워드 기반

Training for temporal sparsity in deep neural networks, application in video processing

2021-07-15 · Amirreza Yousefzadeh, Manolis Sifalakis

Activation sparsity improves compute efficiency and resource utilization in sparsity-aware neural network accelerators. As the predominant operation in DNNs is multiply-accumulate (MAC) of activations with weights to com…

Action RecognitionTemporal Action Localization

Time-Aware Tensor Decomposition for Missing Entry Prediction

2020-12-16 · Dawon Ahn, Jun-Gi Jang, U Kang

Given a time-evolving tensor with missing entries, how can we effectively factorize it for precisely predicting the missing entries? Tensor factorization has been extensively utilized for analyzing various multi-dimensio…

PredictionTensor Decomposition

Dynamic Pondering Sparsity-aware Mixture-of-Experts Transformer for Event Stream based Visual Object Tracking

2026-05-07 · Shiao Wang, Xiao Wang, Duoqing Yang, Wenhao Zhang 외 arxiv

Despite significant progress, RGB-based trackers remain vulnerable to challenging imaging conditions, such as low illumination and fast motion. Event cameras offer a promising alternative by asynchronously capturing pixe…

Computational EfficiencyVisual Object Tracking

Context-aware Sparse Spatiotemporal Learning for Event-based Vision

2025-08-27 · Shenqi Wang, Guangzhi Tang arxiv

Event-based camera has emerged as a promising paradigm for robot perception, offering advantages with high temporal resolution, high dynamic range, and robustness to motion blur. However, existing deep learning-based eve…

Optical Flow EstimationEvent-based visionObject Detection

Causal-INSIGHT: Probing Temporal Models to Extract Causal Structure

2026-03-26 · Benjamin Redden, Hui Wang, Shuyan Li arxiv

Understanding directed temporal interactions in multivariate time series is essential for interpreting complex dynamical systems and the predictive models trained on them. We present Causal-INSIGHT, a model-agnostic, pos…