paper-with-me

홈 › Papers

Self-supervised Autoregressive Domain Adaptation for Time Series Data

2021-11-29 · Mohamed Ragab, Emadeldeen Eldele, Zhenghua Chen, Min Wu, Chee-Keong Kwoh, XiaoLi Li

Unsupervised domain adaptation (UDA) has successfully addressed the domain shift problem for visual applications. Yet, these approaches may have limited performance for time series data due to the following reasons. First, they mainly rely on large-scale dataset (i.e., ImageNet) for the source pretraining, which is not applicable for time-series data. Second, they ignore the temporal dimension on the feature space of the source and target domains during the domain alignment step. Last, most of prior UDA methods can only align the global features without considering the fine-grained class distribution of the target domain. To address these limitations, we propose a Self-supervised Autoregressive Domain Adaptation (SLARDA) framework. In particular, we first design a self-supervised learning module that utilizes forecasting as an auxiliary task to improve the transferability of the source features. Second, we propose a novel autoregressive domain adaptation technique that incorporates temporal dependency of both source and target features during domain alignment. Finally, we develop an ensemble teacher model to align the class-wise distribution in the target domain via a confident pseudo labeling approach. Extensive experiments have been conducted on three real-world time series applications with 30 cross-domain scenarios. Results demonstrate that our proposed SLARDA method significantly outperforms the state-of-the-art approaches for time series domain adaptation.

📄 PDF Abstract BibTeX arXiv:2111.14834

Code (1)

mohamedr002/slarda 공식 구현 pytorch

Tasks

Domain AdaptationSelf-Supervised LearningTime SeriesTime Series AnalysisUnsupervised Domain Adaptation

Similar Papers 제목 키워드 기반

Training Autoregressive Speech Recognition Models with Limited in-domain Supervision

2022-10-27 · Chak-Fai Li, Francis Keith, William Hartmann, Matthew Snover

Advances in self-supervised learning have significantly reduced the amount of transcribed audio required for training. However, the majority of work in this area is focused on read speech. We explore limited supervision …

DecoderSelf-Supervised Learningspeech-recognitionSpeech Recognition

CoMaL: Conditional Maximum Likelihood Approach to Self-supervised Domain Adaptation in Long-tail Semantic Segmentation

2023-04-14 · Thanh-Dat Truong, Chi Nhan Duong, Pierce Helton, Ashley Dowling 외

The research in self-supervised domain adaptation in semantic segmentation has recently received considerable attention. Although GAN-based methods have become one of the most popular approaches to domain adaptation, the…

Domain AdaptationSegmentationSemantic Segmentation

Knothe-Rosenblatt transport for Unsupervised Domain Adaptation

2021-10-06 · Aladin Virmaux, Illyyne Saffar, Jianfeng Zhang, Balázs Kégl

Unsupervised domain adaptation (UDA) aims at exploiting related but different data sources to tackle a common task in a target domain. UDA remains a central yet challenging problem in machine learning. In this paper, we …

Density EstimationDomain AdaptationUnsupervised Domain Adaptation

Test-Time Adaptation for Generalizable Task Progress Estimation

2025-06-11 · Christos Ziakas, Alessandra Russo

We propose a test-time adaptation method that enables a progress estimation model to adapt online to the visual and temporal context of test trajectories by optimizing a learned self-supervised objective. To this end, we…

In-Context LearningMeta-LearningTest-time Adaptation

Self-supervised Domain Adaptation for Computer Vision Tasks

2019-07-25 · Jiaolong Xu, Liang Xiao, Antonio M. Lopez

Recent progress of self-supervised visual representation learning has achieved remarkable success on many challenging computer vision benchmarks. However, whether these techniques can be used for domain adaptation has no…

Domain AdaptationObject RecognitionRepresentation LearningSegmentation+1