paper-with-me

홈 › Papers

Learning Unbiased Transferability for Domain Adaptation by Uncertainty Modeling

2022-06-02 · Jian Hu, Haowen Zhong, Junchi Yan, Shaogang Gong, Guile Wu, Fei Yang

Domain adaptation (DA) aims to transfer knowledge learned from a labeled source domain to an unlabeled or a less labeled but related target domain. Ideally, the source and target distributions should be aligned to each other equally to achieve unbiased knowledge transfer. However, due to the significant imbalance between the amount of annotated data in the source and target domains, usually only the target distribution is aligned to the source domain, leading to adapting unnecessary source specific knowledge to the target domain, i.e., biased domain adaptation. To resolve this problem, in this work, we delve into the transferability estimation problem in domain adaptation and propose a non-intrusive Unbiased Transferability Estimation Plug-in (UTEP) by modeling the uncertainty of a discriminator in adversarial-based DA methods to optimize unbiased transfer. We theoretically analyze the effectiveness of the proposed approach to unbiased transferability learning in DA. Furthermore, to alleviate the impact of imbalanced annotated data, we utilize the estimated uncertainty for pseudo label selection of unlabeled samples in the target domain, which helps achieve better marginal and conditional distribution alignments between domains. Extensive experimental results on a high variety of DA benchmark datasets show that the proposed approach can be readily incorporated into various adversarial-based DA methods, achieving state-of-the-art performance.

📄 PDF Abstract BibTeX arXiv:2206.01319

Code (1)

puchapu/utep 공식 구현 pytorch

Tasks

Domain AdaptationPseudo LabelTransfer Learning

Similar Papers 제목 키워드 기반

Learning Transferable Features with Deep Adaptation Networks

2015-02-10 · Mingsheng Long, Yue Cao, Jian-Min Wang, Michael. I. Jordan

Recent studies reveal that a deep neural network can learn transferable features which generalize well to novel tasks for domain adaptation. However, as deep features eventually transition from general to specific along …

Domain Adaptationimage-classificationImage ClassificationMulti-Source Unsupervised Domain Adaptation

Uncertainty-Induced Transferability Representation for Source-Free Unsupervised Domain Adaptation

2022-08-30 · Jiangbo Pei, Zhuqing Jiang, Aidong Men, Liang Chen 외

Source-free unsupervised domain adaptation (SFUDA) aims to learn a target domain model using unlabeled target data and the knowledge of a well-trained source domain model. Most previous SFUDA works focus on inferring sem…

Domain AdaptationUnsupervised Domain Adaptation

Multi-source Unsupervised Domain Adaptation on Graphs with Transferability Modeling

2024-06-14 · Tianxiang Zhao, Dongsheng Luo, Xiang Zhang, Suhang Wang

In this paper, we tackle a new problem of \textit{multi-source unsupervised domain adaptation (MSUDA) for graphs}, where models trained on annotated source domains need to be transferred to the unsupervised target graph …

Domain AdaptationMeta-LearningMulti-Source Unsupervised Domain AdaptationNode Classification+1

Adversarial Alignment of Class Prediction Uncertainties for Domain Adaptation

2018-04-12 · Jeroen Manders, Twan van Laarhoven, Elena Marchiori

We consider unsupervised domain adaptation: given labelled examples from a source domain and unlabelled examples from a related target domain, the goal is to infer the labels of target examples. Under the assumption that…

Domain Adaptationimage-classificationImage ClassificationPrediction+1

Stochastic Adversarial Gradient Embedding for Active Domain Adaptation

2020-12-03 · Victor Bouvier, Philippe Very, Clément Chastagnol, Myriam Tami 외

Unsupervised Domain Adaptation (UDA) aims to bridge the gap between a source domain, where labelled data are available, and a target domain only represented with unlabelled data. If domain invariant representations have …

Active LearningDiversityDomain AdaptationUnsupervised Domain Adaptation