Joint Monocular 3D Vehicle Detection and Tracking
Vehicle 3D extents and trajectories are critical cues for predicting the future location of vehicles and planning future agent ego-motion based on those predictions. In this paper, we propose a novel online framework for 3D vehicle detection and tracking from monocular videos. The framework can not only associate detections of vehicles in motion over time, but also estimate their complete 3D bounding box information from a sequence of 2D images captured on a moving platform. Our method leverages 3D box depth-ordering matching for robust instance association and utilizes 3D trajectory prediction for re-identification of occluded vehicles. We also design a motion learning module based on an LSTM for more accurate long-term motion extrapolation. Our experiments on simulation, KITTI, and Argoverse datasets show that our 3D tracking pipeline offers robust data association and tracking. On Argoverse, our image-based method is significantly better for tracking 3D vehicles within 30 meters than the LiDAR-centric baseline methods.
Code (1)
Tasks
3D Object Detection3D Pose EstimationAutonomous VehiclesMultiple Object TrackingObject TrackingOnline Multi-Object TrackingPose EstimationTrajectory Predictionvehicle detectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Joint Vanishing Point Extraction and Tracking
We present a novel vanishing point (VP) detection and tracking algorithm for calibrated monocular image sequences. Previous VP detection and tracking methods usually assume known camera poses for all frames or detect a…
Deep MANTA: A Coarse-to-fine Many-Task Network for joint 2D and 3D vehicle analysis from monocular image
In this paper, we present a novel approach, called Deep MANTA (Deep Many-Tasks), for many-task vehicle analysis from a given image. A robust convolutional network is introduced for simultaneous vehicle detection, part lo…
Pose Estimationvehicle detectionVehicle Pose EstimationTime3D: End-to-End Joint Monocular 3D Object Detection and Tracking for Autonomous Driving
While separately leveraging monocular 3D object detection and 2D multi-object tracking can be straightforwardly applied to sequence images in a frame-by-frame fashion, stand-alone tracker cuts off the transmission of the…
3D Object DetectionAutonomous DrivingMonocular 3D Object DetectionMulti-Object Tracking+3Detecting Invisible People
Monocular object detection and tracking have improved drastically in recent years, but rely on a key assumption: that objects are visible to the camera. Many offline tracking approaches reason about occluded objects post…
Depth EstimationMonocular Depth EstimationObjectobject-detection+2A Task-Driven Evaluation of UAV Detection and Tracking under Synthetic Fog
Fog severely degrades the visibility of small unmanned aerial vehicles (UAVs) in skydominant, long-range imagery, reducing the reliability of downstream detection and tracking. This paper presents a task-driven evaluatio…
Monocular Depth EstimationImage RestorationObject Detection