Partial Feature Selection and Alignment for Multi-Source Domain Adaptation
Multi-Source Domain Adaptation (MSDA), which dedicates to transfer the knowledge learned from multiple source domains to an unlabeled target domain, has drawn increasing attention in the research community. By assuming that the source and target domains share consistent key feature representations and identical label space, existing studies on MSDA typically utilize the entire union set of features from both the source and target domains to obtain the feature map and align the map for each category and domain. However, the default setting of MSDA may neglect the issue of "partialness", i.e., 1) a part of the features contained in the union set of multiple source domains may not present in the target domain; 2) the label space of the target domain may not completely overlap with the multiple source domains. In this paper, we unify the above two cases to a more generalized MSDA task as Multi-Source Partial Domain Adaptation (MSPDA). We propose a novel model termed Partial Feature Selection and Alignment (PFSA) to jointly cope with both MSDA and MSPDA tasks. Specifically, we firstly employ a feature selection vector based on the correlation among the features of multiple sources and target domains. We then design three effective feature alignment losses to jointly align the selected features by preserving the domain information of the data sample clusters in the same category and the discrimination between different classes. Extensive experiments on various benchmark datasets for both MSDA and MSPDA tasks demonstrate that our proposed PFSA approach remarkably outperforms the state-of-the-art MSDA and unimodal PDA methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain Adaptationfeature selectionPartial Domain AdaptationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Reconsidering Feature Structure Information and Latent Space Alignment in Partial Multi-label Feature Selection
The purpose of partial multi-label feature selection is to select the most representative feature subset, where the data comes from partial multi-label datasets that have label ambiguity issues. For label disambiguation,…
feature selectionCoupling Adversarial Learning with Selective Voting Strategy for Distribution Alignment in Partial Domain Adaptation
In contrast to a standard closed-set domain adaptation task, partial domain adaptation setup caters to a realistic scenario by relaxing the identical label set assumption. The fact of source label set subsuming the targe…
Domain Adaptationdomain classificationPartial Domain AdaptationTransfer LearningCross-Domain Labeled LDA for Cross-Domain Text Classification
Cross-domain text classification aims at building a classifier for a target domain which leverages data from both source and target domain. One promising idea is to minimize the feature distribution differences of the tw…
ClassificationCross-Domain Text ClassificationGeneral Classificationtext-classification+1BLOCK-EM: Preventing Emergent Misalignment via Latent Blocking
Emergent misalignment can arise when a language model is fine-tuned on a narrowly scoped supervised objective: the model learns the target behavior, yet also develops undesirable out-of-domain behaviors. We investigate a…
Implicit Semantic Response Alignment for Partial Domain Adaptation
Partial Domain Adaptation (PDA) addresses the unsupervised domain adaptation problem where the target label space is a subset of the source label space. Most state-of-art PDA methods tackle the inconsistent label space b…
Domain AdaptationPartial Domain AdaptationUnsupervised Domain Adaptation