Joint Multi-Object Detection and Tracking with Camera-LiDAR Fusion for Autonomous Driving
Multi-object tracking (MOT) with camera-LiDAR fusion demands accurate results of object detection, affinity computation and data association in real time. This paper presents an efficient multi-modal MOT framework with online joint detection and tracking schemes and robust data association for autonomous driving applications. The novelty of this work includes: (1) development of an end-to-end deep neural network for joint object detection and correlation using 2D and 3D measurements; (2) development of a robust affinity computation module to compute occlusion-aware appearance and motion affinities in 3D space; (3) development of a comprehensive data association module for joint optimization among detection confidences, affinities and start-end probabilities. The experiment results on the KITTI tracking benchmark demonstrate the superior performance of the proposed method in terms of both tracking accuracy and processing speed.
Code (1)
Tasks
Autonomous DrivingMulti-Object TrackingObjectobject-detectionObject DetectionObject TrackingSimilar Papers 제목 키워드 기반
Joint Detection, Tracking and Mapping by Semantic Bundle Adjustment
In this paper we propose a novel Semantic Bundle Adjustment framework whereby known rigid stationary objects are detected while tracking the camera and mapping the environment. The system builds on established tracking a…
3D ReconstructionObjectobject-detectionObject DetectionJoint 3D Object Detection and Tracking Using Spatio-Temporal Representation of Camera Image and LiDAR Point Clouds
In this paper, we propose a new joint object detection and tracking (JoDT) framework for 3D object detection and tracking based on camera and LiDAR sensors. The proposed method, referred to as 3D DetecTrack, enables the …
3D Object DetectionGraph Neural NetworkObjectobject-detection+1Efficient Online 3D Multi-Camera Multi-Object Tracking and Pose Estimation
This paper proposes a fast and online method for jointly performing 3D multi-object tracking and pose estimation using multiple monocular cameras. Our algorithm requires only 2D bounding box and pose detections, eliminat…
3D Multi-Object TrackingComputational EfficiencyPose EstimationCFTrack: Center-based Radar and Camera Fusion for 3D Multi-Object Tracking
3D multi-object tracking is a crucial component in the perception system of autonomous driving vehicles. Tracking all dynamic objects around the vehicle is essential for tasks such as obstacle avoidance and path planning…
3D Multi-Object TrackingAutonomous DrivingAutonomous VehiclesMulti-Object Tracking+5MCTR: Multi Camera Tracking Transformer
Multi-camera tracking plays a pivotal role in various real-world applications. While end-to-end methods have gained significant interest in single-camera tracking, multi-camera tracking remains predominantly reliant on h…
Multi-Object TrackingObjectobject-detectionObject Detection+1