Feature Alignment by Uncertainty and Self-Training for Source-Free Unsupervised Domain Adaptation
Most unsupervised domain adaptation (UDA) methods assume that labeled source images are available during model adaptation. However, this assumption is often infeasible owing to confidentiality issues or memory constraints on mobile devices. Some recently developed approaches do not require source images during adaptation, but they show limited performance on perturbed images. To address these problems, we propose a novel source-free UDA method that uses only a pre-trained source model and unlabeled target images. Our method captures the aleatoric uncertainty by incorporating data augmentation and trains the feature generator with two consistency objectives. The feature generator is encouraged to learn consistent visual features away from the decision boundaries of the head classifier. Thus, the adapted model becomes more robust to image perturbations. Inspired by self-supervised learning, our method promotes inter-space alignment between the prediction space and the feature space while incorporating intra-space consistency within the feature space to reduce the domain gap between the source and target domains. We also consider epistemic uncertainty to boost the model adaptation performance. Extensive experiments on popular UDA benchmark datasets demonstrate that the proposed source-free method is comparable or even superior to vanilla UDA methods. Moreover, the adapted models show more robust results when input images are perturbed.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationDomain AdaptationSelf-Supervised LearningUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
Uncertainty-Aware Model Adaptation for Unsupervised Cross-Domain Object Detection
This work tackles the unsupervised cross-domain object detection problem which aims to generalize a pre-trained object detector to a new target domain without labels. We propose an uncertainty-aware model adaptation meth…
Domain AdaptationObjectobject-detectionObject DetectionDomain Adaptive Object Detection via Balancing Between Self-Training and Adversarial Learning
Deep learning based object detectors struggle generalizing to a new target domain bearing significant variations in object and background. Most current methods align domains by using image or instance-level adversarial f…
Objectobject-detectionObject DetectionSynergizing between Self-Training and Adversarial Learning for Domain Adaptive Object Detection
We study adapting trained object detectors to unseen domains manifesting significant variations of object appearance, viewpoints and backgrounds. Most current methods align domains by either using image or instance-level…
Objectobject-detectionObject DetectionSSAL: Synergizing between Self-Training and Adversarial Learning for Domain Adaptive Object Detection
We study adapting trained object detectors to unseen domains manifesting significant variations of object appearance, viewpoints and backgrounds. Most current methods align domains by either using image or instance-level…
Objectobject-detectionObject DetectionUncertainty-Guided Self-Questioning and Answering for Video-Language Alignment
The development of multi-modal models has been rapidly advancing, with some demonstrating remarkable capabilities. However, annotating video-text pairs remains expensive and insufficient. Take video question answering (V…
Question AnsweringVideo Question Answering