paper-with-me

홈 › Papers

Embedded event based object detection with spiking neural network

2024-06-25 · Jonathan Courtois, Pierre-Emmanuel Novac, Edgar Lemaire, Alain Pegatoquet, Benoit Miramond

The complexity of event-based object detection (OD) poses considerable challenges. Spiking Neural Networks (SNNs) show promising results and pave the way for efficient event-based OD. Despite this success, the path to efficient SNNs on embedded devices remains a challenge. This is due to the size of the networks required to accomplish the task and the ability of devices to take advantage of SNNs benefits. Even when "edge" devices are considered, they typically use embedded GPUs that consume tens of watts. In response to these challenges, our research introduces an embedded neuromorphic testbench that utilizes the SPiking Low-power Event-based ArchiTecture (SPLEAT) accelerator. Using an extended version of the Qualia framework, we can train, evaluate, quantize, and deploy spiking neural networks on an FPGA implementation of SPLEAT. We used this testbench to load a state-of-the-art SNN solution, estimate the performance loss associated with deploying the network on dedicated hardware, and run real-world event-based OD on neuromorphic hardware specifically designed for low-power spiking neural networks. Remarkably, our embedded spiking solution, which includes a model with 1.08 million parameters, operates efficiently with 490 mJ per prediction.

📄 PDF Abstract BibTeX arXiv:2406.17617

Code (0)

등록된 구현이 없습니다.

Tasks

object-detectionObject Detection

Methods 이 논문이 사용한 방법론

SNN Spiking Neural Networks (SNNs) are a class of artificial neural networks inspired by the structure and functioning of the brain's neural networks. Unlike traditional…

Similar Papers 제목 키워드 기반

Spiking CenterNet: A Distillation-boosted Spiking Neural Network for Object Detection

2024-02-02 · Lennard Bodden, Franziska Schwaiger, Duc Bach Ha, Lars Kreuzberg 외

In the era of AI at the edge, self-driving cars, and climate change, the need for energy-efficient, small, embedded AI is growing. Spiking Neural Networks (SNNs) are a promising approach to address this challenge, with t…

DecoderKnowledge Distillationobject-detectionObject Detection+1

Object Detection with Spiking Neural Networks on Automotive Event Data

2022-05-09 · Loïc Cordone, Benoît Miramond, Philippe Thierion

Automotive embedded algorithms have very high constraints in terms of latency, accuracy and power consumption. In this work, we propose to train spiking neural networks (SNNs) directly on data coming from event cameras t…

Classificationobject-detectionObject Detection

Exploring Deep Spiking Neural Networks for Automated Driving Applications

2019-01-11 · Sambit Mohapatra, Heinrich Gotzig, Senthil Yogamani, Stefan Milz 외

Neural networks have become the standard model for various computer vision tasks in automated driving including semantic segmentation, moving object detection, depth estimation, visual odometry, etc. The main flavors of …

Depth EstimationMoving Object Detectionobject-detectionObject Detection+2

SFOD: Spiking Fusion Object Detector

2024-03-22 · CVPR 2024 1 · Yimeng Fan, Wei zhang, Changsong Liu, Mingyang Li 외

Event cameras, characterized by high temporal resolution, high dynamic range, low power consumption, and high pixel bandwidth, offer unique capabilities for object detection in specialized contexts. Despite these advanta…

Objectobject-detectionObject Detection

Sequence-SOD: Bio-inspired Sequence-aware Spiking ObjectDetection for Event Cameras

2026-07-29 · Katharina Bendig, René Schuster, Didier Stricker arxiv

Event cameras follow a retina-inspired sensing principle, reporting local intensity changes asynchronously with hightemporal resolution and a wide dynamic range. Spiking Neural Networks (SNNs) complement these sparse eve…

Data Augmentation