Causal Time-Series Synchronization for Multi-Dimensional Forecasting
The process industry's high expectations for Digital Twins require modeling approaches that can generalize across tasks and diverse domains with potentially different data dimensions and distributional shifts i.e., Foundational Models. Despite success in natural language processing and computer vision, transfer learning with (self-) supervised signals for pre-training general-purpose models is largely unexplored in the context of Digital Twins in the process industry due to challenges posed by multi-dimensional time-series data, lagged cause-effect dependencies, complex causal structures, and varying number of (exogenous) variables. We propose a novel channel-dependent pre-training strategy that leverages synchronized cause-effect pairs to overcome these challenges by breaking down the multi-dimensional time-series data into pairs of cause-effect variables. Our approach focuses on: (i) identifying highly lagged causal relationships using data-driven methods, (ii) synchronizing cause-effect pairs to generate training samples for channel-dependent pre-training, and (iii) evaluating the effectiveness of this approach in channel-dependent forecasting. Our experimental results demonstrate significant improvements in forecasting accuracy and generalization capability compared to traditional training methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Time SeriesTransfer LearningSimilar Papers 제목 키워드 기반
Predicting the State of Synchronization of Financial Time Series using Cross Recurrence Plots
Cross-correlation analysis is a powerful tool for understanding the mutual dynamics of time series. This study introduces a new method for predicting the future state of synchronization of the dynamics of two financial t…
Time SeriesTime Series AnalysisOrdinal Synchronization: Using ordinal patterns to capture interdependencies between time series
We introduce Ordinal Synchronization ($OS$) as a new measure to quantify synchronization between dynamical systems. $OS$ is calculated from the extraction of the ordinal patterns related to two time series, their transfo…
Time SeriesTime Series AnalysisUncertainty Assessment and False Discovery Rate Control in High-Dimensional Granger Causal Inference
Causal inference among high-dimensional time series data proves an important research problem in many fields. While in the classical regime one often establishes causality among time series via a concept known as “G…
Causal InferenceTime SeriesTime Series AnalysisTangent Space Causal Inference: Leveraging Vector Fields for Causal Discovery in Dynamical Systems
Causal discovery with time series data remains a challenging yet increasingly important task across many scientific domains. Convergent cross mapping (CCM) and related methods have been proposed to study time series that…
Causal DiscoveryCausal InferenceTime SeriesCausal Discovery with Inverted Self-attention for Multivariate Time Series
Causal discovery in multivariate time series data is challenging due to complex interactions, high dimensionality, and nonlinear dependencies among variables. Existing methods often struggle to capture these complexities…