Domain Generalization under Conditional and Label Shifts via Variational Bayesian Inference
In this work, we propose a domain generalization (DG) approach to learn on several labeled source domains and transfer knowledge to a target domain that is inaccessible in training. Considering the inherent conditional and label shifts, we would expect the alignment of $p(x|y)$ and $p(y)$. However, the widely used domain invariant feature learning (IFL) methods relies on aligning the marginal concept shift w.r.t. $p(x)$, which rests on an unrealistic assumption that $p(y)$ is invariant across domains. We thereby propose a novel variational Bayesian inference framework to enforce the conditional distribution alignment w.r.t. $p(x|y)$ via the prior distribution matching in a latent space, which also takes the marginal label shift w.r.t. $p(y)$ into consideration with the posterior alignment. Extensive experiments on various benchmarks demonstrate that our framework is robust to the label shift and the cross-domain accuracy is significantly improved, thereby achieving superior performance over the conventional IFL counterparts.
Code (0)
등록된 구현이 없습니다.
Tasks
Bayesian InferenceDomain GeneralizationSimilar Papers 제목 키워드 기반
SPDIM: Source-Free Unsupervised Conditional and Label Shift Adaptation in EEG
The non-stationary nature of electroencephalography (EEG) introduces distribution shifts across domains (e.g., days and subjects), posing a significant challenge to EEG-based neurotechnology generalization. Without label…
Brain Computer InterfaceDomain AdaptationEEGEEG based sleep staging+2Robust Domain Generalization under Divergent Marginal and Conditional Distributions
Domain generalization (DG) aims to learn predictive models that can generalize to unseen domains. Most existing DG approaches focus on learning domain-invariant representations under the assumption of conditional distrib…
Domain GeneralizationOptimal Transport for Conditional Domain Matching and Label Shift
We address the problem of unsupervised domain adaptation under the setting of generalized target shift (joint class-conditional and label shifts). For this framework, we theoretically show that, for good generalization, …
Domain AdaptationUnsupervised Domain AdaptationRLSbench: Domain Adaptation Under Relaxed Label Shift
Despite the emergence of principled methods for domain adaptation under label shift, their sensitivity to shifts in class conditional distributions is precariously under explored. Meanwhile, popular deep domain adaptatio…
Domain AdaptationUnified Principles For Multi-Source Transfer Learning Under Label Shifts
We study the label shift problem in multi-source transfer learning and derive new generic principles to control the target generalization risk. Our theoretical grounded framework unifies the principles of conditional fea…
Domain AdaptationTransfer LearningUnsupervised Domain Adaptation