Deep Learning-Based Robust Multi-Object Tracking via Fusion of mmWave Radar and Camera Sensors
Autonomous driving holds great promise in addressing traffic safety concerns by leveraging artificial intelligence and sensor technology. Multi-Object Tracking plays a critical role in ensuring safer and more efficient navigation through complex traffic scenarios. This paper presents a novel deep learning-based method that integrates radar and camera data to enhance the accuracy and robustness of Multi-Object Tracking in autonomous driving systems. The proposed method leverages a Bi-directional Long Short-Term Memory network to incorporate long-term temporal information and improve motion prediction. An appearance feature model inspired by FaceNet is used to establish associations between objects across different frames, ensuring consistent tracking. A tri-output mechanism is employed, consisting of individual outputs for radar and camera sensors and a fusion output, to provide robustness against sensor failures and produce accurate tracking results. Through extensive evaluations of real-world datasets, our approach demonstrates remarkable improvements in tracking accuracy, ensuring reliable performance even in low-visibility scenarios.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous Drivingmotion predictionMulti-Object TrackingObject TrackingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
ORACLE: Occlusion-Resilient and Self-Calibrating mmWave Radar Network for People Tracking
Millimeter wave (mmWave) radar sensors are emerging as valid alternatives to cameras for the pervasive contactless monitoring of people in indoor spaces. However, commercial mmWave radars feature a limited range (up to $…
PositionvalidMmWave Radar and Vision Fusion for Object Detection in Autonomous Driving: A Review
With autonomous driving developing in a booming stage, accurate object detection in complex scenarios attract wide attention to ensure the safety of autonomous driving. Millimeter wave (mmWave) radar and vision fusion is…
3D Object DetectionAutonomous DrivingObjectobject-detection+2mmSnap: Bayesian One-Shot Fusion in a Self-Calibrated mmWave Radar Network
We present mmSnap, a collaborative RF sensing framework using multiple radar nodes, and demonstrate its feasibility and efficacy using commercially available mmWave MIMO radars. Collaborative fusion requires network cali…
Diffusion-Based Point Cloud Super-Resolution for mmWave Radar Data
The millimeter-wave radar sensor maintains stable performance under adverse environmental conditions, making it a promising solution for all-weather perception tasks, such as outdoor mobile robotics. However, the radar p…
Point Cloud Super ResolutionSuper-ResolutionSuccessive Pose Estimation and Beam Tracking for mmWave Vehicular Communication Systems
The millimeter wave (mmWave) radar sensing-aided communications in vehicular mobile communication systems is investigated. To alleviate the beam training overhead under high mobility scenarios, a successive pose estimati…
Pose EstimationRadar odometry