Adaptive Affinity for Associations in Multi-Target Multi-Camera Tracking
Data associations in multi-target multi-camera tracking (MTMCT) usually estimate affinity directly from re-identification (re-ID) feature distances. However, we argue that it might not be the best choice given the difference in matching scopes between re-ID and MTMCT problems. Re-ID systems focus on global matching, which retrieves targets from all cameras and all times. In contrast, data association in tracking is a local matching problem, since its candidates only come from neighboring locations and time frames. In this paper, we design experiments to verify such misfit between global re-ID feature distances and local matching in tracking, and propose a simple yet effective approach to adapt affinity estimations to corresponding matching scopes in MTMCT. Instead of trying to deal with all appearance changes, we tailor the affinity metric to specialize in ones that might emerge during data associations. To this end, we introduce a new data sampling scheme with temporal windows originally used for data associations in tracking. Minimizing the mismatch, the adaptive affinity module brings significant improvements over global re-ID distance, and produces competitive performance on CityFlow and DukeMTMC datasets.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
More Separable and Easier to Segment: A Cluster Alignment Method for Cross-Domain Semantic Segmentation
Feature alignment between domains is one of the mainstream methods for Unsupervised Domain Adaptation (UDA) semantic segmentation. Existing feature alignment methods for semantic segmentation learn domain-invariant featu…
ClusteringDomain AdaptationSegmentationSemantic Segmentation+1Multi-target tracking for video surveillance using deep affinity network: a brief review
Deep learning models are known to function like the human brain. Due to their functional mechanism, they are frequently utilized to accomplish tasks that require human intelligence. Multi-target tracking (MTT) for video …
Deep LearningOnline Multi-Object Tracking and Segmentation with GMPHD Filter and Mask-based Affinity Fusion
In this paper, we propose a highly practical fully online multi-object tracking and segmentation (MOTS) method that uses instance segmentation results as an input. The proposed method is based on the Gaussian mixture pro…
CPUInstance SegmentationMulti-Object TrackingMulti-Object Tracking and Segmentation+2CogMol: Target-Specific and Selective Drug Design for COVID-19 Using Deep Generative Models
The novel nature of SARS-CoV-2 calls for the development of efficient de novo drug design approaches. In this study, we propose an end-to-end framework, named CogMol (Controlled Generation of Molecules), for designing ne…
AttributeDrug DesignRetrosynthesisSpecificityContrastive Transformation for Self-supervised Correspondence Learning
In this paper, we focus on the self-supervised learning of visual correspondence using unlabeled videos in the wild. Our method simultaneously considers intra- and inter-video representation associations for reliable cor…
Object TrackingSelf-Supervised LearningSemantic SegmentationVideo Object Segmentation+2