DirectTracker: 3D Multi-Object Tracking Using Direct Image Alignment and Photometric Bundle Adjustment
Direct methods have shown excellent performance in the applications of visual odometry and SLAM. In this work we propose to leverage their effectiveness for the task of 3D multi-object tracking. To this end, we propose DirectTracker, a framework that effectively combines direct image alignment for the short-term tracking and sliding-window photometric bundle adjustment for 3D object detection. Object proposals are estimated based on the sparse sliding-window pointcloud and further refined using an optimization-based cost function that carefully combines 3D and 2D cues to ensure consistency in image and world space. We propose to evaluate 3D tracking using the recently introduced higher-order tracking accuracy (HOTA) metric and the generalized intersection over union similarity measure to mitigate the limitations of the conventional use of intersection over union for the evaluation of vision-based trackers. We perform evaluation on the KITTI Tracking benchmark for the Car class and show competitive performance in tracking objects both in 2D and 3D.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Multi-Object Tracking3D Object DetectionMulti-Object TrackingObjectobject-detectionObject DetectionObject TrackingVisual OdometrySimilar Papers 제목 키워드 기반
Real-time Multi-Object Tracking Based on Bi-directional Matching
In recent years, anchor-free object detection models combined with matching algorithms are used to achieve real-time muti-object tracking and also ensure high tracking accuracy. However, there are still great challenges …
motion predictionMulti-Object TrackingObjectobject-detection+4ORMOT: A Dataset and Framework for Omnidirectional Referring Multi-Object Tracking
Multi-Object Tracking (MOT) is a fundamental task in computer vision, aiming to track targets across video frames. Existing MOT methods perform well in general visual scenes, but face significant challenges and limitatio…
Multi-Object TrackingTracking Multiple Objects Outside the Line of Sight Using Speckle Imaging
This paper presents techniques for tracking non-line-of-sight (NLOS) objects using speckle imaging. We develop a novel speckle formation and motion model where both the sensor and the source view objects only indirectly …
ClusteringMotion EstimationMono-Camera 3D Multi-Object Tracking Using Deep Learning Detections and PMBM Filtering
Monocular cameras are one of the most commonly used sensors in the automotive industry for autonomous vehicles. One major drawback using a monocular camera is that it only makes observations in the two dimensional image …
3D Multi-Object TrackingAutonomous VehiclesMulti-Object TrackingMultiple Object Tracking+2Real-time Online Multi-Object Tracking in Compressed Domain
Recent online Multi-Object Tracking (MOT) methods have achieved desirable tracking performance. However, the tracking speed of most existing methods is rather slow. Inspired from the fact that the adjacent frames are hig…
Multi-Object TrackingObjectObject TrackingOnline Multi-Object Tracking