paper-with-me

홈 › Papers

Neuromorphic LiDAR-based Bird's Eye View Object Detection using Energy-efficient Spiking Neural Networks

2026-05-24 · Sambit Mohapatra, Senthil Yogamani, Heinrich Gotzig, Patrick Mader arxiv

Autonomous driving perception demands accurate and efficient processing of three-dimensional sensor data under strict power constraints. Traditional convolutional neural networks achieve strong detection accuracy but are computationally intensive, limiting their suitability for deployment on resource-constrained neuromorphic platforms. Spiking neural networks offer a compelling alternative through event-driven sparse computation, yet their application to complex real-world perception tasks such as three-dimensional object detection remains limited. In this work, we propose an end-to-end spiking encoder-decoder network for object detection in bird's eye view representations of LiDAR point clouds, trained using surrogate gradient backpropagation. We train two variants: a membrane potential variant that reads continuous neuron state at the output stage for maximum accuracy, achieving $92.05$/$87.04$/$86.51$ AP at $\mathrm{IoU}\!=\!0.5$ (Easy/Moderate/Hard), and, a fully binary spiking variant that operates exclusively on spike trains at every layer for direct neuromorphic deployment. We evaluate four input spike encoding strategies and demonstrate that allowing the network to learn spike representations directly from data outperforms hand-crafted Poisson, latency, and z-axis encoding schemes on the KITTI benchmark, where sequential frames are unavailable and the BEV input is presented repeatedly across timesteps as a proxy for temporal streaming. A block-wise energy analysis demonstrates a $3.33\times$ reduction in synaptic operation energy over an equivalent CNN under conservative loop-based operation. Together, these results demonstrate the viability of spiking neural networks for accurate and energy-efficient neuromorphic perception in autonomous driving.

📄 PDF Abstract BibTeX arXiv:2605.25293

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingObject DetectionPoint Clouds

Similar Papers 제목 키워드 기반

Fusing Bird View LIDAR Point Cloud and Front View Camera Image for Deep Object Detection

2017-11-17 · Zining Wang, Wei Zhan, Masayoshi Tomizuka

We propose a new method for fusing a LIDAR point cloud and camera-captured images in the deep convolutional neural network (CNN). The proposed method constructs a new layer called non-homogeneous pooling layer to transfo…

3D Object DetectionAutonomous DrivingObjectobject-detection+1

BirdNet+: End-to-End 3D Object Detection in LiDAR Bird's Eye View

2020-03-09 · Alejandro Barrera, Carlos Guindel, Jorge Beltrán, Fernando García

On-board 3D object detection in autonomous vehicles often relies on geometry information captured by LiDAR devices. Albeit image features are typically preferred for detection, numerous approaches take only spatial data …

3D Object DetectionAutonomous VehiclesObjectobject-detection+1

SemanticBEVFusion: Rethink LiDAR-Camera Fusion in Unified Bird's-Eye View Representation for 3D Object Detection

2022-12-09 · Qi Jiang, Hao Sun, Xi Zhang

LiDAR and camera are two essential sensors for 3D object detection in autonomous driving. LiDAR provides accurate and reliable 3D geometry information while the camera provides rich texture with color. Despite the increa…

3D geometry3D Object DetectionAutonomous Drivingobject-detection+1

Lift-Attend-Splat: Bird's-eye-view camera-lidar fusion using transformers

2023-12-22 · James Gunn, Zygmunt Lenyk, Anuj Sharma, Andrea Donati 외

Combining complementary sensor modalities is crucial to providing robust perception for safety-critical robotics applications such as autonomous driving (AD). Recent state-of-the-art camera-lidar fusion methods for AD re…

3D Object DetectionAutonomous DrivingDepth EstimationMonocular Depth Estimation+3

BirdNet: a 3D Object Detection Framework from LiDAR information

2018-05-03 · Jorge Beltran, Carlos Guindel, Francisco Miguel Moreno, Daniel Cruzado 외

Understanding driving situations regardless the conditions of the traffic scene is a cornerstone on the path towards autonomous vehicles; however, despite common sensor setups already include complementary devices such a…

3D Object DetectionAutonomous VehiclesObjectobject-detection+1