paper-with-me

홈 › Papers

Timely Fusion of Surround Radar/Lidar for Object Detection in Autonomous Driving Systems

2023-09-09 · Wenjing Xie, Tao Hu, Neiwen Ling, Guoliang Xing, Chun Jason Xue, Nan Guan

Fusing Radar and Lidar sensor data can fully utilize their complementary advantages and provide more accurate reconstruction of the surrounding for autonomous driving systems. Surround Radar/Lidar can provide 360-degree view sampling with the minimal cost, which are promising sensing hardware solutions for autonomous driving systems. However, due to the intrinsic physical constraints, the rotating speed of surround Radar, and thus the frequency to generate Radar data frames, is much lower than surround Lidar. Existing Radar/Lidar fusion methods have to work at the low frequency of surround Radar, which cannot meet the high responsiveness requirement of autonomous driving systems.This paper develops techniques to fuse surround Radar/Lidar with working frequency only limited by the faster surround Lidar instead of the slower surround Radar, based on the state-of-the-art object detection model MVDNet. The basic idea of our approach is simple: we let MVDNet work with temporally unaligned data from Radar/Lidar, so that fusion can take place at any time when a new Lidar data frame arrives, instead of waiting for the slow Radar data frame. However, directly applying MVDNet to temporally unaligned Radar/Lidar data greatly degrades its object detection accuracy. The key information revealed in this paper is that we can achieve high output frequency with little accuracy loss by enhancing the training procedure to explore the temporal redundancy in MVDNet so that it can tolerate the temporal unalignment of input data. We explore several different ways of training enhancement and compare them quantitatively with experiments.

📄 PDF Abstract BibTeX arXiv:2309.04806

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Drivingobject-detectionObject Detection

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Radar-Lidar Fusion for Object Detection by Designing Effective Convolution Networks

2023-10-30 · Farzeen Munir, Shoaib Azam, Tomasz Kucner, Ville Kyrki 외

Object detection is a core component of perception systems, providing the ego vehicle with information about its surroundings to ensure safe route planning. While cameras and Lidar have significantly advanced perception …

Objectobject-detectionObject DetectionRegion Proposal+1

Bi-LRFusion: Bi-Directional LiDAR-Radar Fusion for 3D Dynamic Object Detection

2023-06-02 · CVPR 2023 1 · Yingjie Wang, Jiajun Deng, Yao Li, Jinshui Hu 외

LiDAR and Radar are two complementary sensing approaches in that LiDAR specializes in capturing an object's 3D shape while Radar provides longer detection ranges as well as velocity hints. Though seemingly natural, how t…

object-detectionObject Detection

TransCAR: Transformer-based Camera-And-Radar Fusion for 3D Object Detection

2023-04-30 · Su Pang, Daniel Morris, Hayder Radha

Despite radar's popularity in the automotive industry, for fusion-based 3D object detection, most existing works focus on LiDAR and camera fusion. In this paper, we propose TransCAR, a Transformer-based Camera-And-Radar …

3D Object DetectionDecoderObjectobject-detection+1

LiRaFusion: Deep Adaptive LiDAR-Radar Fusion for 3D Object Detection

2024-02-18 · Jingyu Song, Lingjun Zhao, Katherine A. Skinner

We propose LiRaFusion to tackle LiDAR-radar fusion for 3D object detection to fill the performance gap of existing LiDAR-radar detectors. To improve the feature extraction capabilities from these two modalities, we desig…

3D Object Detectionobject-detectionObject Detection

Radar Voxel Fusion for 3D Object Detection

2021-06-26 · Felix Nobis, Ehsan Shafiei, Phillip Karle, Johannes Betz 외

Automotive traffic scenes are complex due to the variety of possible scenarios, objects, and weather conditions that need to be handled. In contrast to more constrained environments, such as automated underground trains,…

3D Object DetectionObjectobject-detectionObject Detection+1