MCTR: Multi Camera Tracking Transformer
Multi-camera tracking plays a pivotal role in various real-world applications. While end-to-end methods have gained significant interest in single-camera tracking, multi-camera tracking remains predominantly reliant on heuristic techniques. In response to this gap, this paper introduces Multi-Camera Tracking tRansformer (MCTR), a novel end-to-end approach tailored for multi-object detection and tracking across multiple cameras with overlapping fields of view. MCTR leverages end-to-end detectors like DEtector TRansformer (DETR) to produce detections and detection embeddings independently for each camera view. The framework maintains set of track embeddings that encaplusate global information about the tracked objects, and updates them at every frame by integrating the local information from the view-specific detection embeddings. The track embeddings are probabilistically associated with detections in every camera view and frame to generate consistent object tracks. The soft probabilistic association facilitates the design of differentiable losses that enable end-to-end training of the entire system. To validate our approach, we conduct experiments on MMPTrack and AI City Challenge, two recently introduced large-scale multi-camera multi-object tracking datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Multi-Object TrackingObjectobject-detectionObject DetectionObject TrackingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
UCMCTrack: Multi-Object Tracking with Uniform Camera Motion Compensation
Multi-object tracking (MOT) in video sequences remains a challenging task, especially in scenarios with significant camera movements. This is because targets can drift considerably on the image plane, leading to erroneou…
Motion CompensationMulti-Object TrackingMultiple Object TrackingObject+1OCMCTrack: Online Multi-Target Multi-Camera Tracking with Corrective Matching Cascade
The implementation of multi-target multi-camera tracking systems in indoor environments including shops and warehouses facilitates strategic product positioning and the improvement of operational workflows. This paper pr…
Multi-Object TrackingPositionMCTrack: A Unified 3D Multi-Object Tracking Framework for Autonomous Driving
This paper introduces MCTrack, a new 3D multi-object tracking method that achieves state-of-the-art (SOTA) performance across KITTI, nuScenes, and Waymo datasets. Addressing the gap in existing tracking paradigms, which …
3D Multi-Object TrackingAutonomous DrivingMulti-Object TrackingMultiple Object Tracking+1DualCamCtrl: Dual-Branch Diffusion Model for Geometry-Aware Camera-Controlled Video Generation
This paper presents DualCamCtrl, a novel end-to-end diffusion model for camera-controlled video generation. Recent works have advanced this field by representing camera poses as ray-based conditions, yet they often lack …
Scene UnderstandingVideo GenerationCamCtrl3D: Single-Image Scene Exploration with Precise 3D Camera Control
We propose a method for generating fly-through videos of a scene, from a single image and a given camera trajectory. We build upon an image-to-video latent diffusion model. We condition its UNet denoiser on the camera tr…