paper-with-me

홈 › Papers

Knowledge Distillation for Multi-Target Domain Adaptation in Real-Time Person Re-Identification

2022-05-12 · Félix Remigereau, Djebril Mekhazni, Sajjad Abdoli, Le Thanh Nguyen-Meidine, Rafael M. O. Cruz, Eric Granger

Despite the recent success of deep learning architectures, person re-identification (ReID) remains a challenging problem in real-word applications. Several unsupervised single-target domain adaptation (STDA) methods have recently been proposed to limit the decline in ReID accuracy caused by the domain shift that typically occurs between source and target video data. Given the multimodal nature of person ReID data (due to variations across camera viewpoints and capture conditions), training a common CNN backbone to address domain shifts across multiple target domains, can provide an efficient solution for real-time ReID applications. Although multi-target domain adaptation (MTDA) has not been widely addressed in the ReID literature, a straightforward approach consists in blending different target datasets, and performing STDA on the mixture to train a common CNN. However, this approach may lead to poor generalization, especially when blending a growing number of distinct target domains to train a smaller CNN. To alleviate this problem, we introduce a new MTDA method based on knowledge distillation (KD-ReID) that is suitable for real-time person ReID applications. Our method adapts a common lightweight student backbone CNN over the target domains by alternatively distilling from multiple specialized teacher CNNs, each one adapted on data from a specific target domain. Extensive experiments conducted on several challenging person ReID datasets indicate that our approach outperforms state-of-art methods for MTDA, including blending methods, particularly when training a compact CNN backbone like OSNet. Results suggest that our flexible MTDA approach can be employed to design cost-effective ReID systems for real-time video surveillance applications.

📄 PDF Abstract BibTeX arXiv:2205.06237

Code (1)

fremigereau/mtda_kd_reid 공식 구현 pytorch

Tasks

Domain AdaptationKnowledge DistillationMulti-target Domain AdaptationPerson Re-Identification

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

CoNMix for Source-free Single and Multi-target Domain Adaptation

2022-11-07 · Vikash Kumar, Rohit Lal, Himanshu Patil, Anirban Chakraborty

This work introduces the novel task of Source-free Multi-target Domain Adaptation and proposes adaptation framework comprising of \textbf{Co}nsistency with \textbf{N}uclear-Norm Maximization and \textbf{Mix}Up knowledge …

Domain AdaptationKnowledge DistillationMulti-target Domain AdaptationPseudo Label

Multi-Granularity Class Prototype Topology Distillation for Class-Incremental Source-Free Unsupervised Domain Adaptation

2024-11-25 · CVPR 2025 1 · Peihua Deng, Jiehua Zhang, Xichun Sheng, Chenggang Yan 외

This paper explores the Class-Incremental Source-Free Unsupervised Domain Adaptation (CI-SFUDA) problem, where the unlabeled target data come incrementally without access to labeled source instances. This problem poses t…

class-incremental learningDomain AdaptationRepresentation LearningSource-Free Domain Adaptation+1

Student Becomes Decathlon Master in Retinal Vessel Segmentation via Dual-teacher Multi-target Domain Adaptation

2022-03-07 · Linkai Peng, Li Lin, Pujin Cheng, Huaqing He 외

Unsupervised domain adaptation has been proposed recently to tackle the so-called domain shift between training data and test data with different distributions. However, most of them only focus on single-target domain ad…

Domain AdaptationDomain GeneralizationKnowledge DistillationMulti-target Domain Adaptation+2

Unsupervised Multi-Target Domain Adaptation Through Knowledge Distillation

2020-07-14 · Le Thanh Nguyen-Meidine, Atif Belal, Madhu Kiran, Jose Dolz 외

Unsupervised domain adaptation (UDA) seeks to alleviate the problem of domain shift between the distribution of unlabeled data from the target domain w.r.t. labeled data from the source domain. While the single-target UD…

Domain AdaptationKnowledge DistillationMulti-target Domain AdaptationSpecificity+1

KD3A: Unsupervised Multi-Source Decentralized Domain Adaptation via Knowledge Distillation

2020-11-19 · Hao-Zhe Feng, Zhaoyang You, Minghao Chen, Tianye Zhang 외

Conventional unsupervised multi-source domain adaptation (UMDA) methods assume all source domains can be accessed directly. This neglects the privacy-preserving policy, that is, all the data and computations must be kept…

Domain AdaptationKnowledge DistillationMulti-Source Unsupervised Domain AdaptationPrivacy Preserving+1