Attentive WaveBlock: Complementarity-enhanced Mutual Networks for Unsupervised Domain Adaptation in Person Re-identification and Beyond
Unsupervised domain adaptation (UDA) for person re-identification is challenging because of the huge gap between the source and target domain. A typical self-training method is to use pseudo-labels generated by clustering algorithms to iteratively optimize the model on the target domain. However, a drawback to this is that noisy pseudo-labels generally cause trouble in learning. To address this problem, a mutual learning method by dual networks has been developed to produce reliable soft labels. However, as the two neural networks gradually converge, their complementarity is weakened and they likely become biased towards the same kind of noise. This paper proposes a novel light-weight module, the Attentive WaveBlock (AWB), which can be integrated into the dual networks of mutual learning to enhance the complementarity and further depress noise in the pseudo-labels. Specifically, we first introduce a parameter-free module, the WaveBlock, which creates a difference between features learned by two networks by waving blocks of feature maps differently. Then, an attention mechanism is leveraged to enlarge the difference created and discover more complementary features. Furthermore, two kinds of combination strategies, i.e. pre-attention and post-attention, are explored. Experiments demonstrate that the proposed method achieves state-of-the-art performance with significant improvements on multiple UDA person re-identification tasks. We also prove the generality of the proposed method by applying it to vehicle re-identification and image classification tasks. Our codes and models are available at https://github.com/WangWenhao0716/Attentive-WaveBlock.
Code (1)
Tasks
ClusteringDomain Adaptationimage-classificationImage ClassificationPerson Re-IdentificationUnsupervised Domain AdaptationVehicle Re-IdentificationSimilar Papers 제목 키워드 기반
L-WaveBlock: A Novel Feature Extractor Leveraging Wavelets for Generative Adversarial Networks
Generative Adversarial Networks (GANs) have risen to prominence in the field of deep learning, facilitating the generation of realistic data from random noise. The effectiveness of GANs often depends on the quality of fe…
DenoisingImage DenoisingImage GenerationConfidence Attention and Generalization Enhanced Distillation for Continuous Video Domain Adaptation
Continuous Video Domain Adaptation (CVDA) is a scenario where a source model is required to adapt to a series of individually available changing target domains continuously without source data or target supervision. It h…
Autonomous DrivingDomain AdaptationKnowledge DistillationSelf-Knowledge Distillation+1Trusted Video Inpainting Localization via Deep Attentive Noise Learning
Digital video inpainting techniques have been substantially improved with deep learning in recent years. Although inpainting is originally designed to repair damaged areas, it can also be used as malicious manipulation t…
Semantic SegmentationVideo InpaintingVideo Object SegmentationVideo Semantic SegmentationBalancing Complementarity and Consistency via Delayed Activation in Incomplete Multi-view Clustering
This paper study one challenging issue in incomplete multi-view clustering, where valuable complementary information from other views is always ignored. To be specific, we propose a framework that effectively balances Co…
ClusteringIncomplete multi-view clusteringFusion-then-Distillation: Toward Cross-modal Positive Distillation for Domain Adaptive 3D Semantic Segmentation
In cross-modal unsupervised domain adaptation, a model trained on source-domain data (e.g., synthetic) is adapted to target-domain data (e.g., real-world) without access to target annotation. Previous methods seek to mut…
3D Semantic SegmentationDomain AdaptationSemantic SegmentationUnsupervised Domain Adaptation