Temporal Coherence or Temporal Motion: Which is More Critical for Video-based Person Re-identification?
Video-based person re-identification aims to match pedestrians with the consecutive video sequences. While a rich line of work focuses solely on extracting the motion features from pedestrian videos, we show in this paper that the temporal coherence plays a more critical role. To distill the temporal coherence part of video representation from frame representations, we propose a simple yet effective Adversarial Feature Augmentation (AFA) method, which highlights the temporal coherence features by introducing adversarial augmented temporal motion noise. Specifically, we disentangle the video representation into the temporal coherence and motion parts and randomly change the scale of the temporal motion features as the adversarial noise. The proposed AFA method is a general lightweight component that can be readily incorporated into various methods with negligible cost. We conduct extensive experiments on three challenging datasets including MARS, iLIDS-VID, and DukeMTMC-VideoReID, and the experimental results verify our argument and demonstrate the effectiveness of the proposed method.
Code (0)
등록된 구현이 없습니다.
Tasks
Person Re-IdentificationVideo-Based Person Re-IdentificationSimilar Papers 제목 키워드 기반
EAD-Net: Emotion-Aware Talking Head Generation with Spatial Refinement and Temporal Coherence
Emotionally talking head video generation aims to generate expressive portrait videos with accurate lip synchronization and emotional facial expressions. Current methods rely on simple emotional labels, leading to insuff…
Graph structure learningComputational EfficiencyTalking Head GenerationVideo GenerationUnityGraph: Unified Learning of Spatio-temporal features for Multi-person Motion Prediction
Multi-person motion prediction is a complex and emerging field with significant real-world applications. Current state-of-the-art methods typically adopt dual-path networks to separately modeling spatial features and tem…
motion predictionRecMoDiffuse: Recurrent Flow Diffusion for Human Motion Generation
Human motion generation has paramount importance in computer animation. It is a challenging generative temporal modelling task due to the vast possibilities of human motion, high human sensitivity to motion coherence and…
Motion GenerationSpatiotemporal Co-attention Recurrent Neural Networks for Human-Skeleton Motion Prediction
Human motion prediction aims to generate future motions based on the observed human motions. Witnessing the success of Recurrent Neural Networks (RNN) in modeling the sequential data, recent works utilize RNN to model hu…
Human motion predictionmotion predictionLeft Ventricle Segmentation via Optical-Flow-Net from Short-axis Cine MRI: Preserving the Temporal Coherence of Cardiac Motion
Quantitative assessment of left ventricle (LV) function from cine MRI has significant diagnostic and prognostic value for cardiovascular disease patients. The temporal movement of LV provides essential information on the…
DiagnosticLeft Ventricle SegmentationLV SegmentationOptical Flow Estimation+1