paper-with-me

Papers

Camera Alignment and Weighted Contrastive Learning for Domain Adaptation in Video Person ReID

2022-11-07 · Djebril Mekhazni, Maximilien Dufau, Christian Desrosiers, Marco Pedersoli, Eric Granger

Systems for person re-identification (ReID) can achieve a high accuracy when trained on large fully-labeled image datasets. However, the domain shift typically associated with diverse operational capture conditions (e.g., camera viewpoints and lighting) may translate to a significant decline in performance. This paper focuses on unsupervised domain adaptation (UDA) for video-based ReID - a relevant scenario that is less explored in the literature. In this scenario, the ReID model must adapt to a complex target domain defined by a network of diverse video cameras based on tracklet information. State-of-art methods cluster unlabeled target data, yet domain shifts across target cameras (sub-domains) can lead to poor initialization of clustering methods that propagates noise across epochs, thus preventing the ReID model to accurately associate samples of same identity. In this paper, an UDA method is introduced for video person ReID that leverages knowledge on video tracklets, and on the distribution of frames captured over target cameras to improve the performance of CNN backbones trained using pseudo-labels. Our method relies on an adversarial approach, where a camera-discriminator network is introduced to extract discriminant camera-independent representations, facilitating the subsequent clustering. In addition, a weighted contrastive loss is proposed to leverage the confidence of clusters, and mitigate the risk of incorrect identity associations. Experimental results obtained on three challenging video-based person ReID datasets - PRID2011, iLIDS-VID, and MARS - indicate that our proposed method can outperform related state-of-the-art methods. Our code is available at: \url{https://github.com/dmekhazni/CAWCL-ReID}

📄 PDF Abstract BibTeX arXiv:2211.03626

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringContrastive LearningDomain AdaptationPerson Re-IdentificationUnsupervised Domain Adaptation

Similar Papers 제목 키워드 기반

Contrastive Conditional Alignment based on Label Shift Calibration for Imbalanced Domain Adaptation

2024-12-29 · Xiaona Sun, Zhenyu Wu, ZhiQiang Zhan, Yang Ji

Many existing unsupervised domain adaptation (UDA) methods primarily focus on covariate shift, limiting their effectiveness in imbalanced domain adaptation (IDA) where both covariate shift and label shift coexist. Recent…

Domain AdaptationUnsupervised Domain Adaptation

Cross-domain Detection via Graph-induced Prototype Alignment

2020-03-28 · CVPR 2020 6 · Minghao Xu, Hang Wang, Bingbing Ni, Qi Tian 외

Applying the knowledge of an object detector trained on a specific domain directly onto a new domain is risky, as the gap between two domains can severely degrade model's performance. Furthermore, since different instanc…

Domain Adaptationobject-detectionObject Detection

Spatio-temporal Contrastive Domain Adaptation for Action Recognition

2021-06-19 · CVPR 2021 1 · Xiaolin Song, Sicheng Zhao, Jingyu Yang, Huanjing Yue 외

Unsupervised domain adaptation (UDA) for human action recognition is a practical and challenging problem. Compared with image-based UDA, video-based UDA is comprehensive to bridge the domain shift on both spatial rep…

Action RecognitionContrastive LearningDomain AdaptationSelf-Supervised Learning+2

Towards Generalizable Person Re-identification with a Bi-stream Generative Model

2022-06-19 · Xin Xu, Wei Liu, Zheng Wang, Ruiming Hu 외

Generalizable person re-identification (re-ID) has attracted growing attention due to its powerful adaptation capability in the unseen data domain. However, existing solutions often neglect either crossing cameras (e.g.,…

Domain GeneralizationGeneralizable Person Re-identificationPerson Re-Identification

Unsupervised Contrastive Domain Adaptation for Semantic Segmentation

2022-04-18 · Feihu Zhang, Vladlen Koltun, Philip Torr, René Ranftl 외

Semantic segmentation models struggle to generalize in the presence of domain shift. In this paper, we introduce contrastive learning for feature alignment in cross-domain adaptation. We assemble both in-domain contrasti…

Contrastive LearningDomain AdaptationSemantic Segmentation