paper-with-me

홈 › Papers

Person Re-Identification with a Locally Aware Transformer

2021-06-07 · Charu Sharma, Siddhant R. Kapil, David Chapman

Person Re-Identification is an important problem in computer vision-based surveillance applications, in which the same person is attempted to be identified from surveillance photographs in a variety of nearby zones. At present, the majority of Person re-ID techniques are based on Convolutional Neural Networks (CNNs), but Vision Transformers are beginning to displace pure CNNs for a variety of object recognition tasks. The primary output of a vision transformer is a global classification token, but vision transformers also yield local tokens which contain additional information about local regions of the image. Techniques to make use of these local tokens to improve classification accuracy are an active area of research. We propose a novel Locally Aware Transformer (LA-Transformer) that employs a Parts-based Convolution Baseline (PCB)-inspired strategy for aggregating globally enhanced local classification tokens into an ensemble of $\sqrt{N}$ classifiers, where $N$ is the number of patches. An additional novelty is that we incorporate blockwise fine-tuning which further improves re-ID accuracy. LA-Transformer with blockwise fine-tuning achieves rank-1 accuracy of $98.27 \%$ with standard deviation of $0.13$ on the Market-1501 and $98.7\%$ with standard deviation of $0.2$ on the CUHK03 dataset respectively, outperforming all other state-of-the-art published methods at the time of writing.

📄 PDF Abstract BibTeX arXiv:2106.03720

Code (1)

SiddhantKapil/LA-Transformer 공식 구현 pytorch

Tasks

Object RecognitionPerson Re-Identification

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
AWARE We propose to theoretically and empirically examine the effect of incorporating weighting schemes into walk-aggregating GNNs. To this end, we propose a simple, interpretable, and…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Adam 설명 없음

Similar Papers 제목 키워드 기반

Diverse Part Discovery: Occluded Person Re-identification with Part-Aware Transformer

2021-06-08 · CVPR 2021 1 · Yulin Li, Jianfeng He, Tianzhu Zhang, Xiang Liu 외

Occluded person re-identification (Re-ID) is a challenging task as persons are frequently occluded by various obstacles or other persons, especially in the crowd scenario. To address these issues, we propose a novel end-…

DecoderDiversityOccluded Person Re-IdentificationPerson Re-Identification

Deep Attention Aware Feature Learning for Person Re-Identification

2020-03-01 · Yifan Chen, Han Wang, Xiaolu Sun, Bin Fan 외

Visual attention has proven to be effective in improving the performance of person re-identification. Most existing methods apply visual attention heuristically by learning an additional attention map to re-weight the fe…

Deep AttentionPerson Re-Identification

Identity-Aware Multi-Sentence Video Description

2020-08-22 · ECCV 2020 8 · Jae Sung Park, Trevor Darrell, Anna Rohrbach

Standard video and movie description tasks abstract away from person identities, thus failing to link identities across sentences. We propose a multi-sentence Identity-Aware Video Description task, which overcomes this l…

Gender PredictionSentenceVideo Description

Template-Aware Transformer for Person Reidentification

2022-04-01 · Computational Intelligence and Neuroscience 2022 4 · Yanwei Zheng, Zengrui Zhao, Xiaowei Yu, Dongxiao Yu

Person reidentification (ReID) is a challenging computer vision task for identifying or verifying one or more persons when the faces are not available. In ReID, the indistinguishable background usually affects the model’…

Person Re-Identification

Learning Deep Context-aware Features over Body and Latent Parts for Person Re-identification

2017-10-18 · CVPR 2017 7 · Dangwei Li, Xiaotang Chen, Zhang Zhang, Kaiqi Huang

Person Re-identification (ReID) is to identify the same person across different cameras. It is a challenging task due to the large variations in person pose, occlusion, background clutter, etc How to extract powerful fea…

Person IdentificationPerson Re-IdentificationRepresentation Learning