SpikiLi: A Spiking Simulation of LiDAR based Real-time Object Detection for Autonomous Driving
Spiking Neural Networks are a recent and new neural network design approach that promises tremendous improvements in power efficiency, computation efficiency, and processing latency. They do so by using asynchronous spike-based data flow, event-based signal generation, processing, and modifying the neuron model to resemble biological neurons closely. While some initial works have shown significant initial evidence of applicability to common deep learning tasks, their applications in complex real-world tasks has been relatively low. In this work, we first illustrate the applicability of spiking neural networks to a complex deep learning task namely Lidar based 3D object detection for automated driving. Secondly, we make a step-by-step demonstration of simulating spiking behavior using a pre-trained convolutional neural network. We closely model essential aspects of spiking neural networks in simulation and achieve equivalent run-time and accuracy on a GPU. When the model is realized on a neuromorphic hardware, we expect to have significantly improved power efficiency.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Object DetectionAutonomous DrivingGPUobject-detectionObject DetectionReal-Time Object DetectionSimilar Papers 제목 키워드 기반
Temporal Pulses Driven Spiking Neural Network for Fast Object Recognition in Autonomous Driving
Accurate real-time object recognition from sensory data has long been a crucial and challenging task for autonomous driving. Even though deep neural networks (DNNs) have been successfully applied in this area, most exist…
Autonomous DrivingObjectObject RecognitionOn the Importance of Neural Membrane Potential Leakage for LIDAR-based Robot Obstacle Avoidance using Spiking Neural Networks
Using neuromorphic computing for robotics applications has gained much attention in recent year due to the remarkable ability of Spiking Neural Networks (SNNs) for high-precision yet low memory and compute complexity inf…
Robot NavigationObject Detection based on LIDAR Temporal Pulses using Spiking Neural Networks
Neural networks has been successfully used in the processing of Lidar data, especially in the scenario of autonomous driving. However, existing methods heavily rely on pre-processing of the pulse signals derived from Lid…
Autonomous DrivingBenchmarkingobject-detectionObject Detection+1LiDAR-RT: Gaussian-based Ray Tracing for Dynamic LiDAR Re-simulation
This paper targets the challenge of real-time LiDAR re-simulation in dynamic driving scenarios. Recent approaches utilize neural radiance fields combined with the physical modeling of LiDAR sensors to achieve high-fideli…
Neuromorphic LiDAR-based Bird's Eye View Object Detection using Energy-efficient Spiking Neural Networks
Autonomous driving perception demands accurate and efficient processing of three-dimensional sensor data under strict power constraints. Traditional convolutional neural networks achieve strong detection accuracy but are…
Autonomous DrivingObject DetectionPoint Clouds