Dynamic Prototype Mask for Occluded Person Re-Identification
Although person re-identification has achieved an impressive improvement in recent years, the common occlusion case caused by different obstacles is still an unsettled issue in real application scenarios. Existing methods mainly address this issue by employing body clues provided by an extra network to distinguish the visible part. Nevertheless, the inevitable domain gap between the assistant model and the ReID datasets has highly increased the difficulty to obtain an effective and efficient model. To escape from the extra pre-trained networks and achieve an automatic alignment in an end-to-end trainable network, we propose a novel Dynamic Prototype Mask (DPM) based on two self-evident prior knowledge. Specifically, we first devise a Hierarchical Mask Generator which utilizes the hierarchical semantic to select the visible pattern space between the high-quality holistic prototype and the feature representation of the occluded input image. Under this condition, the occluded representation could be well aligned in a selected subspace spontaneously. Then, to enrich the feature representation of the high-quality holistic prototype and provide a more complete feature space, we introduce a Head Enrich Module to encourage different heads to aggregate different patterns representation in the whole image. Extensive experimental evaluations conducted on occluded and holistic person re-identification benchmarks demonstrate the superior performance of the DPM over the state-of-the-art methods. The code is released at https://github.com/stone96123/DPM.
Code (2)
Tasks
Occluded Person Re-IdentificationPerson Re-IdentificationSimilar Papers 제목 키워드 기반
DPM++: Dynamic Masked Metric Learning for Occluded Person Re-identification
Although person re-identification has made impressive progress, occlusion caused by obstacles remains an unsettled issue in real applications. The difficulty lies in the mismatch between incomplete occluded samples and h…
Person Re-IdentificationData AugmentationMetric LearningDiverse Part Discovery: Occluded Person Re-identification with Part-Aware Transformer
Occluded person re-identification (Re-ID) is a challenging task as persons are frequently occluded by various obstacles or other persons, especially in the crowd scenario. To address these issues, we propose a novel end-…
DecoderDiversityOccluded Person Re-IdentificationPerson Re-IdentificationPose-guided Inter- and Intra-part Relational Transformer for Occluded Person Re-Identification
Person Re-Identification (Re-Id) in occlusion scenarios is a challenging problem because a pedestrian can be partially occluded. The use of local information for feature extraction and matching is still necessary. Theref…
Occluded Person Re-IdentificationPerson Re-IdentificationNeighbourhood-guided Feature Reconstruction for Occluded Person Re-Identification
Person images captured by surveillance cameras are often occluded by various obstacles, which lead to defective feature representation and harm person re-identification (Re-ID) performance. To tackle this challenge, we p…
Graph Neural NetworkOccluded Person Re-IdentificationPerson Re-IdentificationPart Representation Learning with Teacher-Student Decoder for Occluded Person Re-identification
Occluded person re-identification (ReID) is a very challenging task due to the occlusion disturbance and incomplete target information. Leveraging external cues such as human pose or parsing to locate and align part feat…
DecoderHuman ParsingLong-range modelingOccluded Person Re-Identification+2