Multi-Source Unsupervised Domain Adaptation via Pseudo Target Domain
Multi-source domain adaptation (MDA) aims to transfer knowledge from multiple source domains to an unlabeled target domain. MDA is a challenging task due to the severe domain shift, which not only exists between target and source but also exists among diverse sources. Prior studies on MDA either estimate a mixed distribution of source domains or combine multiple single-source models, but few of them delve into the relevant information among diverse source domains. For this reason, we propose a novel MDA approach, termed Pseudo Target for MDA (PTMDA). Specifically, PTMDA maps each group of source and target domains into a group-specific subspace using adversarial learning with a metric constraint, and constructs a series of pseudo target domains correspondingly. Then we align the remainder source domains with the pseudo target domain in the subspace efficiently, which allows to exploit additional structured source information through the training on pseudo target domain and improves the performance on the real target domain. Besides, to improve the transferability of deep neural networks (DNNs), we replace the traditional batch normalization layer with an effective matching normalization layer, which enforces alignments in latent layers of DNNs and thus gains further promotion. We give theoretical analysis showing that PTMDA as a whole can reduce the target error bound and leads to a better approximation of the target risk in MDA settings. Extensive experiments demonstrate PTMDA's effectiveness on MDA tasks, as it outperforms state-of-the-art methods in most experimental settings.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationMulti-Source Unsupervised Domain AdaptationUnsupervised Domain AdaptationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Unsupervised multi-source domain adaptation for person re-identification via feature fusion and pseudo-label refinement
The objective of unsupervised domain adaptation (UDA) for person re-identification (re-ID) is to associate person in images captured from heterogeneous camera perspectives. Currently, mainstream UDA methods for person re…
Domain AdaptationPerson Re-IdentificationPseudo LabelUnsupervised Domain AdaptationSource-Free Domain Adaptive Fundus Image Segmentation with Denoised Pseudo-Labeling
Domain adaptation typically requires to access source domain data to utilize their distribution information for domain alignment with the target data. However, in many real-world scenarios, the source data may not be acc…
DenoisingDomain AdaptationImage SegmentationSemantic Segmentation+1Guiding Pseudo-labels with Uncertainty Estimation for Source-free Unsupervised Domain Adaptation
Standard Unsupervised Domain Adaptation (UDA) methods assume the availability of both source and target data during the adaptation. In this work, we investigate Source-free Unsupervised Domain Adaptation (SF-UDA), a spec…
Domain AdaptationSource-Free Domain AdaptationUnsupervised Domain AdaptationAdversarial Training Based Multi-Source Unsupervised Domain Adaptation for Sentiment Analysis
Multi-source unsupervised domain adaptation (MS-UDA) for sentiment analysis (SA) aims to leverage useful information in multiple source domains to help do SA in an unlabeled target domain that has no supervised informati…
Domain AdaptationMulti-Source Unsupervised Domain AdaptationSentiment AnalysisTransfer Learning+1ATPL: Mutually enhanced adversarial training and pseudo labeling for unsupervised domain adaptation
Unsupervised domain adaptation aims to transfer knowledge from a labeled source domain to a related but unlabeled target domain. Most existing approaches either adversarially reduce the domain shift or use pseudo-labels …
Domain AdaptationUnsupervised Domain Adaptation