Probabilistic Learning of Multivariate Time Series with Temporal Irregularity
Multivariate sequential data collected in practice often exhibit temporal irregularities, including nonuniform time intervals and component misalignment. However, if uneven spacing and asynchrony are endogenous characteristics of the data rather than a result of insufficient observation, the information content of these irregularities plays a defining role in characterizing the multivariate dependence structure. Existing approaches for probabilistic forecasting either overlook the resulting statistical heterogeneities, are susceptible to imputation biases, or impose parametric assumptions on the data distribution. This paper proposes an end-to-end solution that overcomes these limitations by allowing the observation arrival times to play the central role of model construction, which is at the core of temporal irregularities. To acknowledge temporal irregularities, we first enable unique hidden states for components so that the arrival times can dictate when, how, and which hidden states to update. We then develop a conditional flow representation to non-parametrically represent the data distribution, which is typically non-Gaussian, and supervise this representation by carefully factorizing the log-likelihood objective to select conditional information that facilitates capturing time variation and path dependency. The broad applicability and superiority of the proposed solution are confirmed by comparing it with existing approaches through ablation studies and testing on real-world datasets.
Code (1)
Tasks
ImputationTime SeriesSimilar Papers 제목 키워드 기반
Compatible Transformer for Irregularly Sampled Multivariate Time Series
To analyze multivariate time series, most previous methods assume regular subsampling of time series, where the interval between adjacent measurements and the number of samples remain unchanged. Practically, data collect…
Time SeriesImproving Medical Predictions by Irregular Multimodal Electronic Health Records Modeling
Health conditions among patients in intensive care units (ICUs) are monitored via electronic health records (EHRs), composed of numerical time series and lengthy clinical note sequences, both taken at irregular time inte…
ImputationIrregular Time SeriesTime SeriesTime Series AnalysisMultivariate Time Series Imputation with Generative Adversarial Networks
Multivariate time series usually contain a large number of missing values, which hinders the application of advanced analysis methods on multivariate time series data. Conventional approaches to addressing the challenge …
Image GenerationImputationMissing ValuesMultivariate Time Series Imputation+2Temporal Latent Auto-Encoder: A Method for Probabilistic Multivariate Time Series Forecasting
Probabilistic forecasting of high dimensional multivariate time series is a notoriously challenging task, both in terms of computational burden and distribution modeling. Most previous work either makes simple distributi…
DecoderDeep LearningMultivariate Time Series ForecastingTime Series+2HyperIMTS: Hypergraph Neural Network for Irregular Multivariate Time Series Forecasting
Irregular multivariate time series (IMTS) are characterized by irregular time intervals within variables and unaligned observations across variables, posing challenges in learning temporal and variable dependencies. Many…
Multivariate Time Series ForecastingTime SeriesTime Series Forecasting