paper-with-me

홈 › Papers

Multi-Object Tracking with Camera-LiDAR Fusion for Autonomous Driving

2024-03-06 · Riccardo Pieroni, Simone Specchia, Matteo Corno, Sergio Matteo Savaresi

This paper presents a novel multi-modal Multi-Object Tracking (MOT) algorithm for self-driving cars that combines camera and LiDAR data. Camera frames are processed with a state-of-the-art 3D object detector, whereas classical clustering techniques are used to process LiDAR observations. The proposed MOT algorithm comprises a three-step association process, an Extended Kalman filter for estimating the motion of each detected dynamic obstacle, and a track management phase. The EKF motion model requires the current measured relative position and orientation of the observed object and the longitudinal and angular velocities of the ego vehicle as inputs. Unlike most state-of-the-art multi-modal MOT approaches, the proposed algorithm does not rely on maps or knowledge of the ego global pose. Moreover, it uses a 3D detector exclusively for cameras and is agnostic to the type of LiDAR sensor used. The algorithm is validated both in simulation and with real-world data, with satisfactory results.

📄 PDF Abstract BibTeX arXiv:2403.04112

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingManagementMulti-Object TrackingObjectObject TrackingSelf-Driving Cars

Similar Papers 제목 키워드 기반

DeepFusionMOT: A 3D Multi-Object Tracking Framework Based on Camera-LiDAR Fusion with Deep Association

2022-02-24 · Xiyang Wang, Chunyun Fu, Zhankun Li, Ying Lai 외

In the recent literature, on the one hand, many 3D multi-object tracking (MOT) works have focused on tracking accuracy and neglected computation speed, commonly by designing rather complex cost functions and feature extr…

3D Multi-Object TrackingMulti-Object TrackingObjectObject Tracking

ShaSTA-Fuse: Camera-LiDAR Sensor Fusion to Model Shape and Spatio-Temporal Affinities for 3D Multi-Object Tracking

2023-10-04 · Tara Sadjadpour, Rares Ambrus, Jeannette Bohg

3D multi-object tracking (MOT) is essential for an autonomous mobile agent to safely navigate a scene. In order to maximize the perception capabilities of the autonomous agent, we aim to develop a 3D MOT framework that f…

3D Multi-Object TrackingMulti-Object TrackingNavigateObject Tracking+1

CAMO-MOT: Combined Appearance-Motion Optimization for 3D Multi-Object Tracking with Camera-LiDAR Fusion

2022-09-06 · Li Wang, Xinyu Zhang, Wenyuan Qin, Xiaoyu Li 외

3D Multi-object tracking (MOT) ensures consistency during continuous dynamic detection, conducive to subsequent motion planning and navigation tasks in autonomous driving. However, camera-based methods suffer in the case…

3D Multi-Object TrackingAutonomous DrivingMotion PlanningMulti-Object Tracking+2

Security Analysis of Camera-LiDAR Fusion Against Black-Box Attacks on Autonomous Vehicles

2021-06-13 · R. Spencer Hallyburton, Yupei Liu, Yulong Cao, Z. Morley Mao 외

To enable safe and reliable decision-making, autonomous vehicles (AVs) feed sensor data to perception algorithms to understand the environment. Sensor fusion with multi-frame tracking is becoming increasingly popular for…

Autonomous VehiclesDecision MakingSensor Fusion

FutrTrack: A Camera-LiDAR Fusion Transformer for 3D Multiple Object Tracking

2025-10-22 · Martha Teiko Teye, Ori Maoz, Matthias Rottmann arxiv

We propose FutrTrack, a modular camera-LiDAR multi-object tracking framework that builds on existing 3D detectors by introducing a transformer-based smoother and a fusion-driven tracker. Inspired by query-based tracking …

Multiple Object TrackingMulti-Object Tracking