paper-with-me

Papers

Contrastive Conditional Alignment based on Label Shift Calibration for Imbalanced Domain Adaptation

2024-12-29 · Xiaona Sun, Zhenyu Wu, ZhiQiang Zhan, Yang Ji

Many existing unsupervised domain adaptation (UDA) methods primarily focus on covariate shift, limiting their effectiveness in imbalanced domain adaptation (IDA) where both covariate shift and label shift coexist. Recent IDA methods have achieved promising results based on self-training using target pseudo labels. However, under the IDA scenarios, the classifier learned in the source domain will exhibit different decision bias from the target domain. It will potentially make target pseudo labels unreliable, and will further lead to error accumulation with incorrect class alignment. Thus, we propose contrastive conditional alignment based on label shift calibration (CCA-LSC) for IDA, to address both covariate shift and label shift. Initially, our contrastive conditional alignment resolve covariate shift to learn representations with domain invariance and class discriminability, which include domain adversarial learning, sample-weighted moving average centroid alignment and discriminative feature alignment. Subsequently, we estimate the probability distribution of the target domain, and calibrate target sample classification predictions based on label shift metrics to encourage labeling pseudo-labels more consistently with the distribution of real target data. Extensive experiments are conducted and demonstrate that our method outperforms existing UDA and IDA methods on benchmarks with both label shift and covariate shift. Our code is available at https://github.com/ysxcj-hub/CCA-LSC.

📄 PDF Abstract BibTeX arXiv:2412.20337

Code (1)

ysxcj-hub/cca-lsc 공식 구현 pytorch

Tasks

Domain AdaptationUnsupervised Domain Adaptation

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Speed-enhanced Subdomain Adaptation Regression for Long-term Stable Neural Decoding in Brain-computer Interfaces

2024-07-25 · Jiyu Wei, Dazhong Rong, Xinyun Zhu, Qinming He 외

Brain-computer interfaces (BCIs) offer a means to convert neural signals into control signals, providing a potential restoration of movement for people with paralysis. Despite their promise, BCIs face a significant chall…

Contrastive LearningDomain AdaptationregressionSubdomain adaptation

Estimating calibration error under label shift without labels

2023-12-14 · Teodora Popordanoska, Gorjan Radevski, Tinne Tuytelaars, Matthew B. Blaschko

In the face of dataset shift, model calibration plays a pivotal role in ensuring the reliability of machine learning systems. Calibration error (CE) is an indicator of the alignment between the predicted probabilities an…

SPDIM: Source-Free Unsupervised Conditional and Label Shift Adaptation in EEG

2024-10-26 · Shanglin Li, Motoaki Kawanabe, Reinmar J. Kobler

The non-stationary nature of electroencephalography (EEG) introduces distribution shifts across domains (e.g., days and subjects), posing a significant challenge to EEG-based neurotechnology generalization. Without label…

Brain Computer InterfaceDomain AdaptationEEGEEG based sleep staging+2

Domain Generalization under Conditional and Label Shifts via Variational Bayesian Inference

2021-07-22 · Xiaofeng Liu, Bo Hu, Linghao Jin, Xu Han 외

In this work, we propose a domain generalization (DG) approach to learn on several labeled source domains and transfer knowledge to a target domain that is inaccessible in training. Considering the inherent conditional a…

Bayesian InferenceDomain Generalization

Maximum Likelihood with Bias-Corrected Calibration is Hard-To-Beat at Label Shift Adaptation

2019-01-21 · Amr Alexandari, Anshul Kundaje, Avanti Shrikumar

Label shift refers to the phenomenon where the prior class probability p(y) changes between the training and test distributions, while the conditional probability p(x|y) stays fixed. Label shift arises in settings like m…

Diabetic Retinopathy DetectionDomain AdaptationImage ClassificationMedical Diagnosis