paper-with-me

홈 › Papers

Deep Learning-Based Robust Multi-Object Tracking via Fusion of mmWave Radar and Camera Sensors

2024-07-10 · Lei Cheng, Arindam Sengupta, Siyang Cao

Autonomous driving holds great promise in addressing traffic safety concerns by leveraging artificial intelligence and sensor technology. Multi-Object Tracking plays a critical role in ensuring safer and more efficient navigation through complex traffic scenarios. This paper presents a novel deep learning-based method that integrates radar and camera data to enhance the accuracy and robustness of Multi-Object Tracking in autonomous driving systems. The proposed method leverages a Bi-directional Long Short-Term Memory network to incorporate long-term temporal information and improve motion prediction. An appearance feature model inspired by FaceNet is used to establish associations between objects across different frames, ensuring consistent tracking. A tri-output mechanism is employed, consisting of individual outputs for radar and camera sensors and a fusion output, to provide robustness against sensor failures and produce accurate tracking results. Through extensive evaluations of real-world datasets, our approach demonstrates remarkable improvements in tracking accuracy, ensuring reliable performance even in low-visibility scenarios.

📄 PDF Abstract BibTeX arXiv:2407.08049

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Drivingmotion predictionMulti-Object TrackingObject Tracking

Methods 이 논문이 사용한 방법론

Memory Network 설명 없음

Similar Papers 제목 키워드 기반

ORACLE: Occlusion-Resilient and Self-Calibrating mmWave Radar Network for People Tracking

2022-08-30 · Marco Canil, Jacopo Pegoraro, Anish Shastri, Paolo Casari 외

Millimeter wave (mmWave) radar sensors are emerging as valid alternatives to cameras for the pervasive contactless monitoring of people in indoor spaces. However, commercial mmWave radars feature a limited range (up to $…

Positionvalid

MmWave Radar and Vision Fusion for Object Detection in Autonomous Driving: A Review

2021-08-06 · Zhiqing Wei, Fengkai Zhang, Shuo Chang, Yangyang Liu 외

With autonomous driving developing in a booming stage, accurate object detection in complex scenarios attract wide attention to ensure the safety of autonomous driving. Millimeter wave (mmWave) radar and vision fusion is…

3D Object DetectionAutonomous DrivingObjectobject-detection+2

mmSnap: Bayesian One-Shot Fusion in a Self-Calibrated mmWave Radar Network

2025-05-01 · Anirban Banik, Lalitha Giridhar, Aaditya Prakash Kattekola, Anurag Pallaprolu 외

We present mmSnap, a collaborative RF sensing framework using multiple radar nodes, and demonstrate its feasibility and efficacy using commercially available mmWave MIMO radars. Collaborative fusion requires network cali…

Diffusion-Based Point Cloud Super-Resolution for mmWave Radar Data

2024-04-09 · Kai Luan, Chenghao Shi, Neng Wang, Yuwei Cheng 외

The millimeter-wave radar sensor maintains stable performance under adverse environmental conditions, making it a promising solution for all-weather perception tasks, such as outdoor mobile robotics. However, the radar p…

Point Cloud Super ResolutionSuper-Resolution

Successive Pose Estimation and Beam Tracking for mmWave Vehicular Communication Systems

2023-07-30 · Cen Liu, Guangxu Zhu, Fan Liu, Yuanwei Liu 외

The millimeter wave (mmWave) radar sensing-aided communications in vehicular mobile communication systems is investigated. To alleviate the beam training overhead under high mobility scenarios, a successive pose estimati…

Pose EstimationRadar odometry