A Low Latency Adaptive Coding Spiking Framework for Deep Reinforcement Learning

2022-11-21 · Lang Qin, Rui Yan, Huajin Tang

In recent years, spiking neural networks (SNNs) have been used in reinforcement learning (RL) due to their low power consumption and event-driven features. However, spiking reinforcement learning (SRL), which suffers from fixed coding methods, still faces the problems of high latency and poor versatility. In this paper, we use learnable matrix multiplication to encode and decode spikes, improving the flexibility of the coders and thus reducing latency. Meanwhile, we train the SNNs using the direct training method and use two different structures for online and offline RL algorithms, which gives our model a wider range of applications. Extensive experiments have revealed that our method achieves optimal performance with ultra-low latency (as low as 0.8% of other SRL methods) and excellent energy efficiency (up to 5X the DNNs) in different algorithms and different environments.

📄 PDF Abstract BibTeX arXiv:2211.11760

Code (1)

stillwolf/acsf-snn 공식 구현 pytorch

Tasks

Deep Reinforcement LearningOffline RL reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

A Latency Coding Framework for Deep Spiking Neural Networks with Ultra-Low Latency

2026-03-24 · Yi Lu, Jianhao Ding, Zhaofei Yu arxiv

Spiking neural networks (SNNs) offer a biologically inspired computing paradigm with significant potential for energy-efficient neural processing. Among neural coding schemes of SNNs, Time-To-First-Spike (TTFS) coding, w…

Energy-Efficient Neuromorphic Computing for Edge AI: A Framework with Adaptive Spiking Neural Networks and Hardware-Aware Optimization

2026-02-02 · Olaf Yunus Laitinen Imanov, Derya Umut Kulali, Taner Yilmaz, Duygu Erisken 외 arxiv

Edge AI applications increasingly require ultra-low-power, low-latency inference. Neuromorphic computing based on event-driven spiking neural networks (SNNs) offers an attractive path, but practical deployment on resourc…

An Adaptive Sampling and Edge Detection Approach for Encoding Static Images for Spiking Neural Networks

2021-10-19 · Peyton Chandarana, Junlin Ou, Ramtin Zand

Current state-of-the-art methods of image classification using convolutional neural networks are often constrained by both latency and power consumption. This places a limit on the devices, particularly low-power edge de…

Edge Detection image-classification Image Classification

Reinforcement-Guided Hyper-Heuristic Hyperparameter Optimization for Fair and Explainable Spiking Neural Network-Based Financial Fraud Detection

2025-08-23 · Sadman Mohammad Nasif, Md Abrar Jahin, M. F. Mridha arxiv

The growing adoption of home banking systems has increased cyberfraud risks, requiring detection models that are accurate, fair, and explainable. While AI methods show promise, they face challenges including computationa…

Hyperparameter Optimization Reinforcement Learning Fraud Detection

Hyperdimensional Decoding of Spiking Neural Networks

2025-11-11 · Cedrick Kinavuidi, Luca Peres, Oliver Rhodes arxiv

This work presents a novel spiking neural network (SNN) decoding method, combining SNNs with Hyperdimensional computing (HDC). The goal is to create a decoding method with high accuracy, high noise robustness, low latenc…