paper-with-me

Papers

PersonViT: Large-scale Self-supervised Vision Transformer for Person Re-Identification

2024-08-10 · Bin Hu, Xinggang Wang, Wenyu Liu

Person Re-Identification (ReID) aims to retrieve relevant individuals in non-overlapping camera images and has a wide range of applications in the field of public safety. In recent years, with the development of Vision Transformer (ViT) and self-supervised learning techniques, the performance of person ReID based on self-supervised pre-training has been greatly improved. Person ReID requires extracting highly discriminative local fine-grained features of the human body, while traditional ViT is good at extracting context-related global features, making it difficult to focus on local human body features. To this end, this article introduces the recently emerged Masked Image Modeling (MIM) self-supervised learning method into person ReID, and effectively extracts high-quality global and local features through large-scale unsupervised pre-training by combining masked image modeling and discriminative contrastive learning, and then conducts supervised fine-tuning training in the person ReID task. This person feature extraction method based on ViT with masked image modeling (PersonViT) has the good characteristics of unsupervised, scalable, and strong generalization capabilities, overcoming the problem of difficult annotation in supervised person ReID, and achieves state-of-the-art results on publicly available benchmark datasets, including MSMT17, Market1501, DukeMTMC-reID, and Occluded-Duke. The code and pre-trained models of the PersonViT method are released at \url{https://github.com/hustvl/PersonViT} to promote further research in the person ReID field.

📄 PDF Abstract BibTeX arXiv:2408.05398

Code (1)

hustvl/personvit 공식 구현 pytorch

Tasks

Contrastive LearningPerson Re-IdentificationSelf-Supervised LearningUnsupervised Pre-training

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Multi-Head Attention 설명 없음
Attention 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Adam 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

SiT: Self-supervised vIsion Transformer

2021-04-08 · Sara Atito, Muhammad Awais, Josef Kittler

Self-supervised learning methods are gaining increasing traction in computer vision due to their recent success in reducing the gap with supervised learning. In natural language processing (NLP) self-supervised learning …

Few-Shot LearningSelf-Supervised Learning

Scaling and Benchmarking Self-Supervised Visual Representation Learning

2019-05-03 · ICCV 2019 10 · Priya Goyal, Dhruv Mahajan, Abhinav Gupta, Ishan Misra

Self-supervised learning aims to learn representations from the data itself without explicit manual supervision. Existing efforts ignore a crucial aspect of self-supervised learning - the ability to scale to large amount…

Benchmarkingobject-detectionObject DetectionReinforcement Learning+4

Investigating Zero-Shot Generalizability on Mandarin-English Code-Switched ASR and Speech-to-text Translation of Recent Foundation Models with Self-Supervision and Weak Supervision

2023-12-30 · Chih-Kai Yang, Kuan-Po Huang, Ke-Han Lu, Chun-Yi Kuan 외

This work evaluated several cutting-edge large-scale foundation models based on self-supervision or weak supervision, including SeamlessM4T, SeamlessM4T v2, and Whisper-large-v3, on three code-switched corpora. We found …

Speech-to-TextSpeech-to-Text Translation

AVS-Net: Audio-Visual Scale Net for Self-supervised Monocular Metric Depth Estimation

2024-12-02 · Xiaohu Liu, Sascha Hornauer, Fabien Moutarde, Jialiang Lu

Metric depth prediction from monocular videos suffers from bad generalization between datasets and requires supervised depth data for scale-correct training. Self-supervised training using multi-view reconstruction can b…

Depth EstimationDepth PredictionPrediction

NimbleD: Enhancing Self-supervised Monocular Depth Estimation with Pseudo-labels and Large-scale Video Pre-training

2024-08-26 · Albert Luginov, Muhammad Shahzad

We introduce NimbleD, an efficient self-supervised monocular depth estimation learning framework that incorporates supervision from pseudo-labels generated by a large vision model. This framework does not require camera …

Depth EstimationMonocular Depth Estimation