Balancing Discriminability and Transferability for Source-Free Domain Adaptation
Conventional domain adaptation (DA) techniques aim to improve domain transferability by learning domain-invariant representations; while concurrently preserving the task-discriminability knowledge gathered from the labeled source data. However, the requirement of simultaneous access to labeled source and unlabeled target renders them unsuitable for the challenging source-free DA setting. The trivial solution of realizing an effective original to generic domain mapping improves transferability but degrades task discriminability. Upon analyzing the hurdles from both theoretical and empirical standpoints, we derive novel insights to show that a mixup between original and corresponding translated generic samples enhances the discriminability-transferability trade-off while duly respecting the privacy-oriented source-free setting. A simple but effective realization of the proposed insights on top of the existing source-free DA approaches yields state-of-the-art performance with faster convergence. Beyond single-source, we also outperform multi-source prior-arts across both classification and semantic segmentation benchmarks.
Code (1)
Tasks
Domain AdaptationSemantic SegmentationSource-Free Domain AdaptationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Balancing Transferability and Discriminability for Unsupervised Domain Adaptation.
Unsupervised domain adaptation (UDA) aims to leverage a sufficiently labeled source domain to classify or represent the fully unlabeled target domain with a different distribution. Generally, the existing approaches try …
Domain AdaptationRepresentation LearningUnsupervised Domain AdaptationBeyond Boundaries: Leveraging Vision Foundation Models for Source-Free Object Detection
Source-Free Object Detection (SFOD) aims to adapt a source-pretrained object detector to a target domain without access to source data. However, existing SFOD methods predominantly rely on internal knowledge from the sou…
Contrastive LearningObject DetectionTransferability vs. Discriminability: Batch Spectral Penalization for Adversarial Domain Adaptation
Adversarial domain adaptation has made remarkable advances in learning transferable representations for knowledge transfer across domains. While adversarial learning strengthens the feature transferability which the comm…
Domain AdaptationTransfer LearningMADI: Inter-domain Matching and Intra-domain Discrimination for Cross-domain Speech Recognition
End-to-end automatic speech recognition (ASR) usually suffers from performance degradation when applied to a new domain due to domain shift. Unsupervised domain adaptation (UDA) aims to improve the performance on the unl…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Cross-environment ASRDomain Adaptation+3Harmonizing Transferability and Discriminability for Adapting Object Detectors
Recent advances in adaptive object detection have achieved compelling results in virtue of adversarial feature adaptation to mitigate the distributional shifts along the detection pipeline. Whilst adversarial adaptation …
Objectobject-detectionObject DetectionWeakly Supervised Object Detection