Efficient Video and Audio processing with Loihi 2
Loihi 2 is an asynchronous, brain-inspired research processor that generalizes several fundamental elements of neuromorphic architecture, such as stateful neuron models communicating with event-driven spikes, in order to address limitations of the first generation Loihi. Here we explore and characterize some of these generalizations, such as sigma-delta encapsulation, resonate-and-fire neurons, and integer-valued spikes, as applied to standard video, audio, and signal processing tasks. We find that these new neuromorphic approaches can provide orders of magnitude gains in combined efficiency and latency (energy-delay-product) for feed-forward and convolutional neural networks applied to video, audio denoising, and spectral transforms compared to state-of-the-art solutions.
Code (0)
등록된 구현이 없습니다.
Tasks
Audio DenoisingDenoisingSimilar Papers 제목 키워드 기반
Efficient Neuromorphic Signal Processing with Loihi 2
The biologically inspired spiking neurons used in neuromorphic computing are nonlinear filters with dynamic state variables -- very different from the stateless neuron models used in deep learning. The next version of In…
Audio ClassificationOptical Flow EstimationImplementing and Benchmarking the Locally Competitive Algorithm on the Loihi 2 Neuromorphic Processor
Neuromorphic processors have garnered considerable interest in recent years for their potential in energy-efficient and high-speed computing. The Locally Competitive Algorithm (LCA) has been utilized for power efficient …
BenchmarkingCPUGPUA Diagonal Structured State Space Model on Loihi 2 for Efficient Streaming Sequence Processing
Deep State-Space Models (SSM) demonstrate state-of-the art performance on long-range sequence modeling tasks. While the recurrent structure of SSMs can be efficiently implemented as a convolution or as a parallel scan du…
State Space ModelsRegion Masking to Accelerate Video Processing on Neuromorphic Hardware
The rapidly growing demand for on-chip edge intelligence on resource-constrained devices has motivated approaches to reduce energy and latency of deep learning models. Spiking neural networks (SNNs) have gained particula…
object-detectionObject DetectionVideo Object DetectionNeuromorphic Principles for Efficient Large Language Models on Intel Loihi 2
Large language models (LLMs) deliver impressive performance but require large amounts of energy. In this work, we present a MatMul-free LLM architecture adapted for Intel's neuromorphic processor, Loihi 2. Our approach l…
GPU