Deep Recurrent Convolutional Networks for Video-based Person Re-identification: An End-to-End Approach
In this paper, we present an end-to-end approach to simultaneously learn spatio-temporal features and corresponding similarity metric for video-based person re-identification. Given the video sequence of a person, features from each frame that are extracted from all levels of a deep convolutional network can preserve a higher spatial resolution from which we can model finer motion patterns. These low-level visual percepts are leveraged into a variant of recurrent model to characterize the temporal variation between time-steps. Features from all time-steps are then summarized using temporal pooling to produce an overall feature representation for the complete sequence. The deep convolutional network, recurrent layer, and the temporal pooling are jointly trained to extract comparable hidden-unit representations from input pair of time series to compute their corresponding similarity value. The proposed framework combines time series modeling and metric learning to jointly learn relevant features and a good similarity measure between time sequences of person. Experiments demonstrate that our approach achieves the state-of-the-art performance for video-based person re-identification on iLIDS-VID and PRID 2011, the two primary public datasets for this purpose.
Code (0)
등록된 구현이 없습니다.
Tasks
Metric LearningPerson Re-IdentificationTime SeriesTime Series AnalysisVideo-Based Person Re-IdentificationSimilar Papers 제목 키워드 기반
Recurrent Convolutional Network for Video-Based Person Re-Identification
In this paper we propose a novel recurrent neural network architecture for video-based person re-identification. Given the video sequence of a person, features are extracted from each frame using a convolutional neural n…
Optical Flow EstimationPerson Re-IdentificationVideo-Based Person Re-IdentificationVideo-based Person Re-identification with Accumulative Motion Context
Video based person re-identification plays a central role in realistic security and video surveillance. In this paper we propose a novel Accumulative Motion Context (AMOC) network for addressing this important problem, w…
Person Re-IdentificationVideo-Based Person Re-IdentificationVideo-based Person Re-Identification using Gated Convolutional Recurrent Neural Networks
Deep neural networks have been successfully applied to solving the video-based person re-identification problem with impressive results reported. The existing networks for person re-id are designed to extract discriminat…
Optical Flow EstimationPerson Re-IdentificationVideo-Based Person Re-IdentificationVideo-based Person Re-identification with Accumulative Motion Context
Video based person re-identification plays a central role in realistic security and video surveillance. In this paper we propose a novel Accumulative Motion Context (AMOC) network for addressing this important problem, w…
Person Re-IdentificationVideo-Based Person Re-IdentificationOrdered or Orderless: A Revisit for Video based Person Re-Identification
Is recurrent network really necessary for learning a good visual representation for video based person re-identification (VPRe-id)? In this paper, we first show that the common practice of employing recurrent neural netw…
DiagnosticPerson Re-IdentificationVideo-Based Person Re-Identification