paper-with-me

Papers

Exploring Domain-Invariant Parameters for Source Free Domain Adaptation

2022-01-01 · CVPR 2022 1 · Fan Wang, Zhongyi Han, Yongshun Gong, Yilong Yin

Source-free domain adaptation (SFDA) newly emerges to transfer the relevant knowledge of a well-trained source model to an unlabeled target domain, which is critical in various privacy-preserving scenarios. Most existing methods focus on learning the domain-invariant representations depending solely on the target data, leading to the obtained representations are target-specific. In this way, they cannot fully address the distribution shift problem across domains. In contrast, we provide a fascinating insight: rather than attempting to learn domain-invariant representations, it is better to explore the domain-invariant parameters of the source model. The motivation behind this insight is clear: the domain-invariant representations are dominated by only partial parameters of an available deep source model. We devise the Domain-Invariant Parameter Exploring (DIPE) approach to capture such domain-invariant parameters in the source model to generate domain-invariant representations. A distinguishing method is developed correspondingly for two types of parameters, i.e., domain-invariant and domain-specific parameters, as well as an effective update strategy based on the clustering correction technique and a target hypothesis is proposed. Extensive experiments verify that DIPE successfully exceeds the current state-of-the-art models on many domain adaptation datasets.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Domain AdaptationPrivacy PreservingSource-Free Domain Adaptation

Similar Papers 제목 키워드 기반

Winning Prize Comes from Losing Tickets: Improve Invariant Learning by Exploring Variant Parameters for Out-of-Distribution Generalization

2023-10-25 · Zhuo Huang, Muyang Li, Li Shen, Jun Yu 외

Out-of-Distribution (OOD) Generalization aims to learn robust models that generalize well to various environments without fitting to distribution-specific features. Recent studies based on Lottery Ticket Hypothesis (LTH)…

Out-of-Distribution Generalization

Transfer Learning with Label Noise

2017-07-31 · Xiyu Yu, Tongliang Liu, Mingming Gong, Kun Zhang 외

Transfer learning aims to improve learning in target domain by borrowing knowledge from a related but different source domain. To reduce the distribution shift between source and target domains, recent methods have focus…

DenoisingTransfer Learning

Two stages domain invariant representation learners solve the large co-variate shift in unsupervised domain adaptation with two dimensional data domains

2024-12-06 · Hisashi Oshima, Tsuyoshi Ishizone, Tomoyuki Higuchi

Recent developments in the unsupervised domain adaptation (UDA) enable the unsupervised machine learning (ML) prediction for target data, thus this will accelerate real world applications with ML models such as image rec…

Domain AdaptationRepresentation LearningUnsupervised Domain Adaptation

Learning to Learn Domain-invariant Parameters for Domain Generalization

2022-11-04 · Feng Hou, Yao Zhang, Yang Liu, Jin Yuan 외

Due to domain shift, deep neural networks (DNNs) usually fail to generalize well on unknown test data in practice. Domain generalization (DG) aims to overcome this issue by capturing domain-invariant representations from…

Domain Generalization

Cross-domain Contrastive Learning for Unsupervised Domain Adaptation

2021-06-10 · Rui Wang, Zuxuan Wu, Zejia Weng, Jingjing Chen 외

Unsupervised domain adaptation (UDA) aims to transfer knowledge learned from a fully-labeled source domain to a different unlabeled target domain. Most existing UDA methods learn domain-invariant feature representations …

ClusteringContrastive LearningDomain Adaptationimage-classification+3