paper-with-me

Papers

Real-Time 3D Object Detection Using InnovizOne LiDAR and Low-Power Hailo-8 AI Accelerator

2024-12-07 · Itay Krispin-Avraham, Roy Orfaig, Ben-Zion Bobrovsky

Object detection is a significant field in autonomous driving. Popular sensors for this task include cameras and LiDAR sensors. LiDAR sensors offer several advantages, such as insensitivity to light changes, like in a dark setting and the ability to provide 3D information in the form of point clouds, which include the ranges of objects. However, 3D detection methods, such as PointPillars, typically require high-power hardware. Additionally, most common spinning LiDARs are sparse and may not achieve the desired quality of object detection in front of the car. In this paper, we present the feasibility of performing real-time 3D object detection of cars using 3D point clouds from a LiDAR sensor, processed and deployed on a low-power Hailo-8 AI accelerator. The LiDAR sensor used in this study is the InnovizOne sensor, which captures objects in higher quality compared to spinning LiDAR techniques, especially for distant objects. We successfully achieved real-time inference at a rate of approximately 5Hz with a high accuracy of 0.91% F1 score, with only -0.2% degradation compared to running the same model on an NVIDIA GeForce RTX 2080 Ti. This work demonstrates that effective real-time 3D object detection can be achieved on low-cost, low-power hardware, representing a significant step towards more accessible autonomous driving technologies. The source code and the pre-trained models are available at https://github.com/AIROTAU/ PointPillarsHailoInnoviz/tree/main

📄 PDF Abstract BibTeX arXiv:2412.05594

Code (1)

airotau/pointpillarshailoinnoviz 공식 구현 pytorch

Tasks

3D Object DetectionAutonomous DrivingObjectobject-detectionObject Detection

Similar Papers 제목 키워드 기반

Real-time object detection and tracking using flash LiDAR imagery

2024-06-07 · Proc. SPIE, Automatic Target Recognition XXXIV 2024 6 · Daniel Carvalho, Art Lompado, Riccardo Consolo, Abhijit Bhattacharjee 외

In this study, we present a real-time vehicle detection program that combines the You-Only-Look-Once-X (YOLOX) object detection algorithm with a multi-object Kalman filter tracker, specifically designed for analyzing 3D …

3D Object ClassificationObjectobject-detectionObject Detection+2

VALO: A Versatile Anytime Framework for LiDAR-based Object Detection Deep Neural Networks

2024-09-17 · Ahmet Soyyigit, Shuochao Yao, Heechul Yun

This work addresses the challenge of adapting dynamic deadline requirements for LiDAR object detection deep neural networks (DNNs). The computing latency of object detection is critically important to ensure safe and eff…

Objectobject-detectionObject Detection

3D Object Detection Method Based on YOLO and K-Means for Image and Point Clouds

2020-04-21 · Xuanyu YIN, Yoko SASAKI, Weimin WANG, Kentaro SHIMIZU

Lidar based 3D object detection and classification tasks are essential for autonomous driving(AD). A lidar sensor can provide the 3D point cloud data reconstruction of the surrounding environment. However, real time dete…

2D Object Detection3D Object Detection3D Object RecognitionAutonomous Driving+8

Real-time Dynamic Object Detection for Autonomous Driving using Prior 3D-Maps

2018-09-28 · B Ravi Kiran, Luis Roldão, Benat Irastorza, Renzo Verastegui 외

Lidar has become an essential sensor for autonomous driving as it provides reliable depth estimation. Lidar is also the primary sensor used in building 3D maps which can be used even in the case of low-cost systems which…

Autonomous DrivingClusteringDepth Estimationobject-detection+1

YOLO and K-Means Based 3D Object Detection Method on Image and Point Cloud

2020-04-21 · Xuanyu YIN, Yoko SASAKI, Weimin WANG, Kentaro SHIMIZU

Lidar based 3D object detection and classification tasks are essential for automated driving(AD). A Lidar sensor can provide the 3D point coud data reconstruction of the surrounding environment. But the detection in 3D p…

2D Object Detection3D Object Detection3D Object RecognitionClustering+6