paper-with-me

Papers

Deep into The Domain Shift: Transfer Learning through Dependence Regularization

2023-05-31 · Shumin Ma, Zhiri Yuan, Qi Wu, Yiyan Huang, Xixu Hu, Cheuk Hang Leung, Dongdong Wang, Zhixiang Huang

Classical Domain Adaptation methods acquire transferability by regularizing the overall distributional discrepancies between features in the source domain (labeled) and features in the target domain (unlabeled). They often do not differentiate whether the domain differences come from the marginals or the dependence structures. In many business and financial applications, the labeling function usually has different sensitivities to the changes in the marginals versus changes in the dependence structures. Measuring the overall distributional differences will not be discriminative enough in acquiring transferability. Without the needed structural resolution, the learned transfer is less optimal. This paper proposes a new domain adaptation approach in which one can measure the differences in the internal dependence structure separately from those in the marginals. By optimizing the relative weights among them, the new regularization strategy greatly relaxes the rigidness of the existing approaches. It allows a learning machine to pay special attention to places where the differences matter the most. Experiments on three real-world datasets show that the improvements are quite notable and robust compared to various benchmark domain adaptation models.

📄 PDF Abstract BibTeX arXiv:2305.19499

Code (1)

yzr1991/deep_into_the_domain_shift 공식 구현 pytorch

Tasks

Domain AdaptationTransfer Learning

Similar Papers 제목 키워드 기반

Algorithmic Fairness Generalization under Covariate and Dependence Shifts Simultaneously

2023-11-23 · Chen Zhao, Kai Jiang, Xintao Wu, Haoliang Wang 외

The endeavor to preserve the generalization of a fair and invariant classifier across domains, especially in the presence of distribution shifts, becomes a significant and intricate challenge in machine learning. In resp…

Domain GeneralizationFairnessNavigate

From Multi-label Learning to Cross-Domain Transfer: A Model-Agnostic Approach

2022-07-24 · Jesse Read

In multi-label learning, a particular case of multi-task learning where a single data point is associated with multiple target labels, it was widely assumed in the literature that, to obtain best accuracy, the dependence…

Multi-Label LearningMulti-Task LearningTransfer Learning

DIB-OD: Preserving the Invariant Core for Robust Heterogeneous Graph Adaptation via Decoupled Information Bottleneck and Online Distillation

2026-04-13 · Yang Yan, Qiuyan Wang, Tianjin Huang, Qiudong Yu 외 arxiv

Graph Neural Network pretraining is pivotal for leveraging unlabeled graph data. However, generalizing across heterogeneous domains remains a major challenge due to severe distribution shifts. Existing methods primarily …

Graph Neural NetworkDomain Adaptation

Maximizing Conditional Independence for Unsupervised Domain Adaptation

2022-03-07 · Yi-Ming Zhai, You-Wei Luo

Unsupervised domain adaptation studies how to transfer a learner from a labeled source domain to an unlabeled target domain with different distributions. Existing methods mainly focus on matching the marginal distributio…

Domain AdaptationUnsupervised Domain Adaptation

Partial Domain Adaptation via Importance Sampling-based Shift Correction

2025-07-27 · Cheng-Jun Guo, Chuan-Xian Ren, You-Wei Luo, Xiao-Lin Xu 외 arxiv

Partial domain adaptation (PDA) is a challenging task in real-world machine learning scenarios. It aims to transfer knowledge from a labeled source domain to a related unlabeled target domain, where the support set of th…

Partial Domain Adaptation