paper-with-me

홈 › Papers

MCTR: Multi Camera Tracking Transformer

2024-08-23 · Alexandru Niculescu-Mizil, Deep Patel, Iain Melvin

Multi-camera tracking plays a pivotal role in various real-world applications. While end-to-end methods have gained significant interest in single-camera tracking, multi-camera tracking remains predominantly reliant on heuristic techniques. In response to this gap, this paper introduces Multi-Camera Tracking tRansformer (MCTR), a novel end-to-end approach tailored for multi-object detection and tracking across multiple cameras with overlapping fields of view. MCTR leverages end-to-end detectors like DEtector TRansformer (DETR) to produce detections and detection embeddings independently for each camera view. The framework maintains set of track embeddings that encaplusate global information about the tracked objects, and updates them at every frame by integrating the local information from the view-specific detection embeddings. The track embeddings are probabilistically associated with detections in every camera view and frame to generate consistent object tracks. The soft probabilistic association facilitates the design of differentiable losses that enable end-to-end training of the entire system. To validate our approach, we conduct experiments on MMPTrack and AI City Challenge, two recently introduced large-scale multi-camera multi-object tracking datasets.

📄 PDF Abstract BibTeX arXiv:2408.13243

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-Object TrackingObjectobject-detectionObject DetectionObject Tracking

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

UCMCTrack: Multi-Object Tracking with Uniform Camera Motion Compensation

2023-12-14 · Kefu Yi, Kai Luo, Xiaolei Luo, Jiangui Huang 외

Multi-object tracking (MOT) in video sequences remains a challenging task, especially in scenarios with significant camera movements. This is because targets can drift considerably on the image plane, leading to erroneou…

Motion CompensationMulti-Object TrackingMultiple Object TrackingObject+1

OCMCTrack: Online Multi-Target Multi-Camera Tracking with Corrective Matching Cascade

2024-06-17 · CVPR 2024 6 · Andreas Specker

The implementation of multi-target multi-camera tracking systems in indoor environments including shops and warehouses facilitates strategic product positioning and the improvement of operational workflows. This paper pr…

Multi-Object TrackingPosition

MCTrack: A Unified 3D Multi-Object Tracking Framework for Autonomous Driving

2024-09-23 · Xiyang Wang, Shouzheng Qi, Jieyou Zhao, Hangning Zhou 외

This paper introduces MCTrack, a new 3D multi-object tracking method that achieves state-of-the-art (SOTA) performance across KITTI, nuScenes, and Waymo datasets. Addressing the gap in existing tracking paradigms, which …

3D Multi-Object TrackingAutonomous DrivingMulti-Object TrackingMultiple Object Tracking+1

DualCamCtrl: Dual-Branch Diffusion Model for Geometry-Aware Camera-Controlled Video Generation

2025-11-28 · Hongfei Zhang, Kanghao Chen, Zixin Zhang, Harold Haodong Chen 외 arxiv

This paper presents DualCamCtrl, a novel end-to-end diffusion model for camera-controlled video generation. Recent works have advanced this field by representing camera poses as ray-based conditions, yet they often lack …

Scene UnderstandingVideo Generation

CamCtrl3D: Single-Image Scene Exploration with Precise 3D Camera Control

2025-01-10 · Stefan Popov, Amit Raj, Michael Krainin, Yuanzhen Li 외

We propose a method for generating fly-through videos of a scene, from a single image and a given camera trajectory. We build upon an image-to-video latent diffusion model. We condition its UNet denoiser on the camera tr…