paper-with-me

홈 › Papers

SNN Architecture for Differential Time Encoding Using Decoupled Processing Time

2023-11-24 · Daniel Windhager, Bernhard A. Moser, Michael Lunglmayr

Spiking neural networks (SNNs) have gained attention in recent years due to their ability to handle sparse and event-based data better than regular artificial neural networks (ANNs). Since the structure of SNNs is less suited for typically used accelerators such as GPUs than conventional ANNs, there is a demand for custom hardware accelerators for processing SNNs. In the past, the main focus was on platforms that resemble the structure of multiprocessor systems. In this work, we propose a lightweight neuron layer architecture that allows network structures to be directly mapped onto digital hardware. Our approach is based on differential time coding of spike sequences and the decoupling of processing time and spike timing that allows the SNN to be processed on different hardware platforms. We present synthesis and performance results showing that this architecture can be implemented for networks of more than 1000 neurons with high clock speeds on a State-of-the-Art FPGA. We furthermore show results on the robustness of our approach to quantization. These results demonstrate that high-accuracy inference can be performed with bit widths as low as 4.

📄 PDF Abstract BibTeX arXiv:2311.14447

Code (0)

등록된 구현이 없습니다.

Tasks

Quantization

Methods 이 논문이 사용한 방법론

Focus 설명 없음
SNN Spiking Neural Networks (SNNs) are a class of artificial neural networks inspired by the structure and functioning of the brain's neural networks. Unlike traditional…

Similar Papers 제목 키워드 기반

Spiking Neural Network Accelerator Architecture for Differential-Time Representation using Learned Encoding

2025-01-14 · Daniel Windhager, Lothar Ratschbacher, Bernhard A. Moser, Michael Lunglmayr

Spiking Neural Networks (SNNs) have garnered attention over recent years due to their increased energy efficiency and advantages in terms of operational complexity compared to traditional Artificial Neural Networks (ANNs…

Differential syntactic and semantic encoding in LLMs

2026-01-08 · Santiago Acevedo, Alessandro Laio, Marco Baroni arxiv

We study how syntactic and semantic information is encoded in inner layer representations of Large Language Models (LLMs), focusing on the very large DeepSeek-V3. We find that, by averaging hidden-representation vectors …

TimeMAE: Self-Supervised Representations of Time Series with Decoupled Masked Autoencoders

2023-03-01 · Mingyue Cheng, Qi Liu, Zhiding Liu, Hao Zhang 외

Enhancing the expressive capacity of deep learning-based time series models with self-supervised pre-training has become ever-increasingly prevalent in time series classification. Even though numerous efforts have been d…

Time SeriesTime Series AnalysisTime Series Classification

Multilingual Neural Machine Translation With Soft Decoupled Encoding

2019-02-09 · ICLR 2019 5 · Xinyi Wang, Hieu Pham, Philip Arthur, Graham Neubig

Multilingual training of neural machine translation (NMT) systems has led to impressive accuracy improvements on low-resource languages. However, there are still significant challenges in efficiently learning word repres…

Machine TranslationNMTTranslation

Decoupled Temporal Encoding for Generative Recommendation

2026-08-17 · Pengfei Jia, Jingjian Wang, Jingmao Li, Ge Zhang 외 arxiv

Positional encoding is a fundamental component of Transformer-based generative recommendation models, where user histories are modeled as autoregressive item sequences. Most positional encoding methods are inherited from…