paper-with-me

홈 › Papers

Spiking neural networks trained with backpropagation for low power neuromorphic implementation of voice activity detection

2019-10-22 · Flavio Martinelli, Giorgia Dellaferrera, Pablo Mainar, Milos Cernak

Recent advances in Voice Activity Detection (VAD) are driven by artificial and Recurrent Neural Networks (RNNs), however, using a VAD system in battery-operated devices requires further power efficiency. This can be achieved by neuromorphic hardware, which enables Spiking Neural Networks (SNNs) to perform inference at very low energy consumption. Spiking networks are characterized by their ability to process information efficiently, in a sparse cascade of binary events in time called spikes. However, a big performance gap separates artificial from spiking networks, mostly due to a lack of powerful SNN training algorithms. To overcome this problem we exploit an SNN model that can be recast into an RNN-like model and trained with known deep learning techniques. We describe an SNN training procedure that achieves low spiking activity and pruning algorithms to remove 85% of the network connections with no performance loss. The model achieves state-of-the-art performance with a fraction of power consumption comparing to other methods.

📄 PDF Abstract BibTeX arXiv:1910.09993

Code (0)

등록된 구현이 없습니다.

Tasks

Action DetectionActivity Detection

Methods 이 논문이 사용한 방법론

Pruning 설명 없음

Similar Papers 제목 키워드 기반

The Backpropagation Algorithm Implemented on Spiking Neuromorphic Hardware

2021-06-13 · Alpha Renner, Forrest Sheldon, Anatoly Zlotnik, Louis Tao 외

The capabilities of natural neural systems have inspired new generations of machine learning algorithms as well as neuromorphic very large-scale integrated (VLSI) circuits capable of fast, low-power information processin…

BIG-bench Machine LearningEdge-computingImage Classification

In-Hardware Learning of Multilayer Spiking Neural Networks on a Neuromorphic Processor

2021-05-08 · Amar Shrestha, Haowen Fang, Daniel Patrick Rider, Zaidao Mei 외

Although widely used in machine learning, backpropagation cannot directly be applied to SNN training and is not feasible on a neuromorphic processor that emulates biological neuron and synapses. This work presents a spik…

BIG-bench Machine Learning

MT-Spike: A Multilayer Time-based Spiking Neuromorphic Architecture with Temporal Error Backpropagation

2018-03-14 · Tao Liu, Zihao Liu, Fuhong Lin, Yier Jin 외

Modern deep learning enabled artificial neural networks, such as Deep Neural Network (DNN) and Convolutional Neural Network (CNN), have achieved a series of breaking records on a broad spectrum of recognition application…

A Spiking Network for Inference of Relations Trained with Neuromorphic Backpropagation

2019-03-11 · Johannes C. Thiele, Olivier Bichler, Antoine Dupret, Sergio Solinas 외

The increasing need for intelligent sensors in a wide range of everyday objects requires the existence of low power information processing systems which can operate autonomously in their environment. In particular, mergi…

Sensor Fusion

SpikeGrad: An ANN-equivalent Computation Model for Implementing Backpropagation with Spikes

2019-06-03 · ICLR 2020 1 · Johannes Christian Thiele, Olivier Bichler, Antoine Dupret

Event-based neuromorphic systems promise to reduce the energy consumption of deep learning tasks by replacing expensive floating point operations on dense matrices by low power sparse and asynchronous operations on spike…