Generalizable Person Re-identification with Relevance-aware Mixture of Experts
Domain generalizable (DG) person re-identification (ReID) is a challenging problem because we cannot access any unseen target domain data during training. Almost all the existing DG ReID methods follow the same pipeline where they use a hybrid dataset from multiple source domains for training, and then directly apply the trained model to the unseen target domains for testing. These methods often neglect individual source domains' discriminative characteristics and their relevances w.r.t. the unseen target domains, though both of which can be leveraged to help the model's generalization. To handle the above two issues, we propose a novel method called the relevance-aware mixture of experts (RaMoE), using an effective voting-based mixture mechanism to dynamically leverage source domains' diverse characteristics to improve the model's generalization. Specifically, we propose a decorrelation loss to make the source domain networks (experts) keep the diversity and discriminability of individual domains' characteristics. Besides, we design a voting network to adaptively integrate all the experts' features into the more generalizable aggregated features with domain relevance. Considering the target domains' invisibility during training, we propose a novel learning-to-learn algorithm combined with our relation alignment loss to update the voting network. Extensive experiments demonstrate that our proposed RaMoE outperforms the state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Generalizable Person Re-identificationMixture-of-ExpertsPerson Re-IdentificationSimilar Papers 제목 키워드 기반
Mimic Embedding via Adaptive Aggregation: Learning Generalizable Person Re-identification
Domain generalizable (DG) person re-identification (ReID) aims to test across unseen domains without access to the target domain data at training time, which is a realistic but challenging problem. In contrast to methods…
Generalizable Person Re-identificationMixture-of-ExpertsPerson Re-IdentificationUnsupervised Domain AdaptationAdaptive Domain-Specific Normalization for Generalizable Person Re-Identification
Although existing person re-identification (Re-ID) methods have shown impressive accuracy, most of them usually suffer from poor generalization on unseen target domain. Thus, generalizable person Re-ID has recently drawn…
Generalizable Person Re-identificationMeta-LearningPerson Re-IdentificationUnleashing the Potential of Pre-Trained Diffusion Models for Generalizable Person Re-Identification
Domain-generalizable re-identification (DG Re-ID) aims to train a model on one or more source domains and evaluate its performance on unseen target domains, a task that has attracted growing attention due to its practica…
Contrastive LearningGeneralizable Person Re-identificationPerson Re-IdentificationRepresentation LearningReMix: Training Generalized Person Re-identification on a Mixture of Data
Modern person re-identification (Re-ID) methods have a weak generalization ability and experience a major accuracy drop when capturing environments change. This is because existing multi-camera Re-ID datasets are limited…
DiversityGeneralizable Person Re-identificationPerson Re-IdentificationTAL: Two-stream Adaptive Learning for Generalizable Person Re-identification
Domain generalizable person re-identification aims to apply a trained model to unseen domains. Prior works either combine the data in all the training domains to capture domain-invariant features, or adopt a mixture of e…
Domain GeneralizationGeneralizable Person Re-identificationMixture-of-ExpertsPerson Re-Identification+1