Improving Deep Visual Representation for Person Re-identification by Global and Local Image-language Association
Person re-identification is an important task that requires learning discriminative visual features for distinguishing different person identities. Diverse auxiliary information has been utilized to improve the visual feature learning. In this paper, we propose to exploit natural language description as additional training supervisions for effective visual features. Compared with other auxiliary information, language can describe a specific person from more compact and semantic visual aspects, thus is complementary to the pixel-level image data. Our method not only learns better global visual feature with the supervision of the overall description but also enforces semantic consistencies between local visual and linguistic features, which is achieved by building global and local image-language associations. The global image-language association is established according to the identity labels, while the local association is based upon the implicit correspondences between image regions and noun phrases. Extensive experiments demonstrate the effectiveness of employing language as training supervisions with the two association schemes. Our method achieves state-of-the-art performance without utilizing any auxiliary information during testing and shows better performance than other joint embedding methods for the image-language association.
Code (0)
등록된 구현이 없습니다.
Tasks
Person Re-IdentificationText based Person RetrievalSimilar Papers 제목 키워드 기반
Person Re-Identification by Deep Joint Learning of Multi-Loss Classification
Existing person re-identification (re-id) methods rely mostly on either localised or global feature representation alone. This ignores their joint benefit and mutual complementary effects. In this work, we show the advan…
feature selectionGeneral ClassificationPerson Re-IdentificationDiscovering Underlying Person Structure Pattern with Relative Local Distance for Person Re-identification
Modeling the underlying person structure for person re-identification (re-ID) is difficult due to diverse deformable poses, changeable camera views and imperfect person detectors. How to exploit underlying person structu…
Person Re-IdentificationRepresentation LearningDeepPFCN: Deep Parallel Feature Consensus Network For Person Re-Identification
Person re-identification aims to associate images of the same person over multiple non-overlapping camera views at different times. Depending on the human operator, manual re-identification in large camera networks is hi…
Person Re-IdentificationImproving Description-based Person Re-identification by Multi-granularity Image-text Alignments
Description-based person re-identification (Re-id) is an important task in video surveillance that requires discriminative cross-modal representations to distinguish different people. It is difficult to directly measure …
Image DescriptionPerson Re-IdentificationText based Person RetrievalHand-Based Person Identification using Global and Part-Aware Deep Feature Representation Learning
In cases of serious crime, including sexual abuse, often the only available information with demonstrated potential for identification is images of the hands. Since this evidence is captured in uncontrolled situations, i…
Person IdentificationPose EstimationRepresentation Learning