Synthehicle: Multi-Vehicle Multi-Camera Tracking in Virtual Cities
Smart City applications such as intelligent traffic routing or accident prevention rely on computer vision methods for exact vehicle localization and tracking. Due to the scarcity of accurately labeled data, detecting and tracking vehicles in 3D from multiple cameras proves challenging to explore. We present a massive synthetic dataset for multiple vehicle tracking and segmentation in multiple overlapping and non-overlapping camera views. Unlike existing datasets, which only provide tracking ground truth for 2D bounding boxes, our dataset additionally contains perfect labels for 3D bounding boxes in camera- and world coordinates, depth estimation, and instance, semantic and panoptic segmentation. The dataset consists of 17 hours of labeled video material, recorded from 340 cameras in 64 diverse day, rain, dawn, and night scenes, making it the most extensive dataset for multi-target multi-camera tracking so far. We provide baselines for detection, vehicle re-identification, and single- and multi-camera tracking. Code and data are publicly available.
Code (1)
Tasks
Depth EstimationMulti-Object TrackingPanoptic SegmentationSegmentationVehicle Re-IdentificationSimilar Papers 제목 키워드 기반
Spatial-Temporal Multi-Cuts for Online Multiple-Camera Vehicle Tracking
Accurate online multiple-camera vehicle tracking is essential for intelligent transportation systems, autonomous driving, and smart city applications. Like single-camera multiple-object tracking, it is commonly formulate…
Autonomous DrivingMulti-Object TrackingMultiple Object TrackingObject TrackingLifting Multi-View Detection and Tracking to the Bird's Eye View
Taking advantage of multi-view aggregation presents a promising solution to tackle challenges such as occlusion and missed detection in multi-object tracking and detection. Recent advancements in multi-view detection and…
3D Object RecognitionMulti-Object Trackingmulti-view detectionMultiview Detection+2Multi-target multi-camera vehicle tracking using transformer-based camera link model and spatial-temporal information
Multi-target multi-camera tracking (MTMCT) of vehicles, i.e. tracking vehicles across multiple cameras, is a crucial application for the development of smart city and intelligent traffic system. The main challenges of MT…
Traffic-Aware Multi-Camera Tracking of Vehicles Based on ReID and Camera Link Model
Multi-target multi-camera tracking (MTMCT), i.e., tracking multiple targets across multiple cameras, is a crucial technique for smart city applications. In this paper, we propose an effective and reliable MTMCT framework…
ClusteringVehicle Re-IdentificationCity-Scale Multi-Camera Vehicle Tracking Guided by Crossroad Zones
Multi-Target Multi-Camera Tracking has a wide range of applications and is the basis for many advanced inferences and predictions. This paper describes our solution to the Track 3 multi-camera vehicle tracking task in 20…
ClusteringVehicle Re-Identification