Invariant Representation Learning for Source-Free Time Series Forecasting with LLM-Centric Proxy Denoising
Effective time series forecasting enables various real-world applications, benefiting from the proliferation of mobile devices. However, the volume of time series data may vary significantly across domains due to high data acquisition costs and data regulations. To maximally create value from sparse data, this study focuses on a new problem of source-free time series forecasting, aiming to adapt a pretrained model from sufficient source time series to the sparse target time series without access to the source data, enabling data protection. To achieve this, we propose TimeID, a novel source-free time series forecasting framework with a large language model (LLM) centric proxy denoising inspired by the powerful generalization capabilities of LLMs. Specifically, TimeID consists of three key components: (1) dual-branch invariant disentangled feature learning that enforces representation- and gradient-wise invariance by means of season-trend decomposition; (2) lightweight, parameter-free proxy denoising that dynamically calibrates systematic biases of LLMs; and (3) knowledge distillation that bidirectionally aligns the denoised prediction and the original target prediction. Extensive experiments on real-world datasets demonstrate that TimeID outperforms state-of-the-art baselines, improving MSE and MAE by 10.7% and 9.3% on average. The code is available at https://github.com/decisionintelligence/TimeID.
Code (0)
등록된 구현이 없습니다.
Tasks
Source-Free Domain AdaptationTime Series ForecastingKnowledge DistillationSimilar Papers 제목 키워드 기반
NP-Free: A Real-Time Normalization-free and Parameter-tuning-free Representation Approach for Open-ended Time Series
As more connected devices are implemented in a cyber-physical world and data is expected to be collected and processed in real time, the ability to handle time series data has become increasingly significant. To help ana…
Time SeriesTime Series Domain Adaptation via Sparse Associative Structure Alignment
Domain adaptation on time series data is an important but challenging task. Most of the existing works in this area are based on the learning of the domain-invariant representation of the data with the help of restrictio…
Domain AdaptationTime SeriesTime Series AnalysisContrastive Learning for Unsupervised Domain Adaptation of Time Series
Unsupervised domain adaptation (UDA) aims at learning a machine learning model using a labeled source domain that performs well on a similar yet different, unlabeled target domain. UDA is important in many applications s…
Contrastive LearningDomain AdaptationTime SeriesTime Series Analysis+1Exploring Domain-Invariant Parameters for Source Free Domain Adaptation
Source-free domain adaptation (SFDA) newly emerges to transfer the relevant knowledge of a well-trained source model to an unlabeled target domain, which is critical in various privacy-preserving scenarios. Most exis…
Domain AdaptationPrivacy PreservingSource-Free Domain AdaptationTimeEmb: A Lightweight Static-Dynamic Disentanglement Framework for Time Series Forecasting
Temporal non-stationarity, the phenomenon that time series distributions change over time, poses fundamental challenges to reliable time series forecasting. Intuitively, the complex time series can be decomposed into two…
Time Series Forecasting