TransPL: VQ-Code Transition Matrices for Pseudo-Labeling of Time Series Unsupervised Domain Adaptation
Unsupervised domain adaptation (UDA) for time series data remains a critical challenge in deep learning, with traditional pseudo-labeling strategies failing to capture temporal patterns and channel-wise shifts between domains, producing sub-optimal pseudo-labels. As such, we introduce TransPL, a novel approach that addresses these limitations by modeling the joint distribution $P(\mathbf{X}, y)$ of the source domain through code transition matrices, where the codes are derived from vector quantization (VQ) of time series patches. Our method constructs class- and channel-wise code transition matrices from the source domain and employs Bayes' rule for target domain adaptation, generating pseudo-labels based on channel-wise weighted class-conditional likelihoods. TransPL offers three key advantages: explicit modeling of temporal transitions and channel-wise shifts between different domains, versatility towards different UDA scenarios (e.g., weakly-supervised UDA), and explainable pseudo-label generation. We validate TransPL's effectiveness through extensive analysis on four time series UDA benchmarks and confirm that it consistently outperforms state-of-the-art pseudo-labeling methods by a strong margin (6.1% accuracy improvement, 4.9% F1 improvement), while providing interpretable insights into the domain adaptation process through its learned code transition matrices.
Code (1)
Tasks
Domain AdaptationPseudo LabelQuantizationTime SeriesUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
De-Confusing Pseudo-Labels in Source-Free Domain Adaptation
Source-free domain adaptation aims to adapt a source-trained model to an unlabeled target domain without access to the source data. It has attracted growing attention in recent years, where existing approaches focus on s…
Domain AdaptationSource-Free Domain AdaptationIterative pseudo-labeling based adaptive copy-paste supervision for semi-supervised tumor segmentation
Semi-supervised learning (SSL) has attracted considerable attention in medical image processing. The latest SSL methods use a combination of consistency regularization and pseudo-labeling to achieve remarkable success. H…
Medical Image SegmentationTumor SegmentationData AugmentationPseudoSeg: Designing Pseudo Labels for Semantic Segmentation
Recent advances in semi-supervised learning (SSL) demonstrate that a combination of consistency regularization and pseudo-labeling can effectively improve image classification accuracy in the low-data regime. Compared to…
Data Augmentationimage-classificationImage ClassificationSegmentation+2Curriculum Labeling: Revisiting Pseudo-Labeling for Semi-Supervised Learning
In this paper we revisit the idea of pseudo-labeling in the context of semi-supervised learning where a learning algorithm has access to a small set of labeled samples and a large set of unlabeled samples. Pseudo-labelin…
Image ClassificationAnalysis of Pseudo-Labeling for Online Source-Free Universal Domain Adaptation
A domain (distribution) shift between training and test data often hinders the real-world performance of deep neural networks, necessitating unsupervised domain adaptation (UDA) to bridge this gap. Online source-free UDA…
Domain AdaptationPseudo LabelUniversal Domain AdaptationUnsupervised Domain Adaptation