paper-with-me

홈 › Papers

ELSA: An ELastic SNN Inference Architecture for Efficient Neuromorphic Computing

2026-05-20 · Kang You, Chen Nie, Lee Jun Yan, Ziling Wei, Cheng Zou, Zekai Xu, Yu Feng, Honglan Jiang, Zhezhi He arxiv

Spiking neural networks (SNNs) exploit event-driven and addition-only computation to substantially improve efficiency for intelligent computation. A key temporal property of SNNs, elastic inference, allows outputs to emerge progressively, enabling responses to salient inputs much earlier than full evaluation. However, existing SNN-specific accelerators cannot capitalize on this property. Layer-by-layer designs emit outputs only after all layers are complete, while time-step-by-time-step designs rely on coarse-grained, layer-wise pipelines that require synchronizing all spines/tokens within a layer. This barrier prevents results from being forwarded immediately, delaying the earliest possible response and forfeiting the benefits of elastic inference. To address these challenges, we propose ELSA, a near-SRAM dataflow architecture that realizes true elastic inference through a fine-grained spine/token-wise pipeline and hardware optimizations tailored to SNNs. ELSA forwards each spine/token immediately upon production, forming a continuous streaming pipeline that substantially reduces the latency to the first response. To enhance this lightweight execution, ELSA introduces a bundled address event representation protocol to lower communication traffic of network-on-chip (NoC), and leverages mini-batch spiking Gustavson-product to cut memory access and exploit inherent sparsity. Combined with mapping and scheduling optimizations, ELSA achieves efficient, event-driven computation without compromising accuracy. Experiments show that SNNs can outperform quantized artificial neural networks (QANNs) while maintaining on-par accuracy. For a 4-bit ResNet-50, ELSA achieves 3.4$\times$ speedup and 13.6$\times$ higher energy efficiency over the SOTA QANN accelerator (ANT), and 2.9$\times$ speedup and 22.1$\times$ energy efficiency gains over the SOTA SNN accelerator (PAICORE).

📄 PDF Abstract BibTeX arXiv:2605.20802

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

ELSA3D: Elastic Semantic Anchoring for Unified 3D Understanding and Generation

2026-07-07 · Tianjiao Yu, Xinzhuo Li, Yifan Shen, Onkar Susladkar 외 arxiv

Unified 3D foundation models aspire to generate 3D assets and reason about them in language within a single backbone, but their text-3D interaction remains largely implicit. Existing methods concatenate text and 3D token…

3D Generation

PARIS and ELSA: An Elastic Scheduling Algorithm for Reconfigurable Multi-GPU Inference Servers

2022-02-27 · Yunseong Kim, Yujeong Choi, Minsoo Rhu

In cloud machine learning (ML) inference systems, providing low latency to end-users is of utmost importance. However, maximizing server utilization and system throughput is also crucial for ML service providers as it he…

GPUScheduling

ELSA: A Throughput-Optimized Design of an LSTM Accelerator for Energy-Constrained Devices

2019-10-19 · Elham Azari, Sarma Vrudhula

The next significant step in the evolution and proliferation of artificial intelligence technology will be the integration of neural network (NN) models within embedded and mobile systems. This calls for the design of co…

Language ModelingLanguage Modelling

Neuromorphic Computing for Content-based Image Retrieval

2020-08-04 · Te-Yuan Liu, Ata Mahjoubfar, Daniel Prusinski, Luis Stevens

Neuromorphic computing mimics the neural activity of the brain through emulating spiking neural networks. In numerous machine learning tasks, neuromorphic chips are expected to provide superior solutions in terms of cost…

BIG-bench Machine LearningContent-Based Image RetrievalCPUGPU+3

Neuromorphic Wireless Split Computing with Multi-Level Spikes

2024-11-07 · Dengyu Wu, Jiechen Chen, Bipin Rajendran, H. Vincent Poor 외

Inspired by biological processes, neuromorphic computing leverages spiking neural networks (SNNs) to perform inference tasks, offering significant efficiency gains for workloads involving sequential data. Recent advances…