Video Person Re-identification by Temporal Residual Learning
In this paper, we propose a novel feature learning framework for video person re-identification (re-ID). The proposed framework largely aims to exploit the adequate temporal information of video sequences and tackle the poor spatial alignment of moving pedestrians. More specifically, for exploiting the temporal information, we design a temporal residual learning (TRL) module to simultaneously extract the generic and specific features of consecutive frames. The TRL module is equipped with two bi-directional LSTM (BiLSTM), which are respectively responsible to describe a moving person in different aspects, providing complementary information for better feature representations. To deal with the poor spatial alignment in video re-ID datasets, we propose a spatial-temporal transformer network (ST^2N) module. Transformation parameters in the ST^2N module are learned by leveraging the high-level semantic information of the current frame as well as the temporal context knowledge from other frames. The proposed ST^2N module with less learnable parameters allows effective person alignments under significant appearance changes. Extensive experimental results on the large-scale MARS, PRID2011, ILIDS-VID and SDU-VID datasets demonstrate that the proposed method achieves consistently superior performance and outperforms most of the very recent state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Person Re-IdentificationVideo-Based Person Re-IdentificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Spatial-Temporal Synergic Residual Learning for Video Person Re-Identification
We tackle the problem of person re-identification in video setting in this paper, which has been viewed as a crucial task in many applications. Meanwhile, it is very challenging since the task requires learning effective…
Person Re-IdentificationVideo-Based Person Re-IdentificationMulti-scale 3D Convolution Network for Video Based Person Re-Identification
This paper proposes a two-stream convolution network to extract spatial and temporal cues for video based person Re-Identification (ReID). A temporal stream in this network is constructed by inserting several Multi-scale…
Person Re-IdentificationVideo-Based Person Re-IdentificationTemporal Complementarity-Guided Reinforcement Learning for Image-to-Video Person Re-Identification
Image-to-video person re-identification aims to retrieve the same pedestrian as the image-based query from a video-based gallery set. Existing methods treat it as a cross-modality retrieval task and learn the common …
Deep Reinforcement LearningImage-To-Video Person Re-IdentificationPerson Re-Identificationreinforcement-learning+4Convolutional Temporal Attention Model for Video-based Person Re-identification
The goal of video-based person re-identification is to match two input videos, so that the distance of the two videos is small if two videos contain the same person. A common approach for person re-identification is to f…
Person Re-IdentificationSemantic SegmentationVideo-Based Person Re-IdentificationVideo-based Person Re-identification Using Spatial-Temporal Attention Networks
We consider the problem of video-based person re-identification. The goal is to identify a person from videos captured under different cameras. In this paper, we propose an efficient spatial-temporal attention based mode…
Person Re-IdentificationVideo-Based Person Re-Identification