Encoding Temporal Statistical-space Priors via Augmented Representation
Modeling time series data remains a pervasive issue as the temporal dimension is inherent to numerous domains. Despite significant strides in time series forecasting, high noise-to-signal ratio, non-normality, non-stationarity, and lack of data continue challenging practitioners. In response, we leverage a simple representation augmentation technique to overcome these challenges. Our augmented representation acts as a statistical-space prior encoded at each time step. In response, we name our method Statistical-space Augmented Representation (SSAR). The underlying high-dimensional data-generating process inspires our representation augmentation. We rigorously examine the empirical generalization performance on two data sets with two downstream temporal learning algorithms. Our approach significantly beats all five up-to-date baselines. Moreover, the highly modular nature of our approach can easily be applied to various settings. Lastly, fully-fledged theoretical perspectives are available throughout the writing for a clear and rigorous understanding.
Code (0)
등록된 구현이 없습니다.
Tasks
Time SeriesTime Series ForecastingSimilar Papers 제목 키워드 기반
Weakly Augmented Variational Autoencoder in Time Series Anomaly Detection
Due to their unsupervised training and uncertainty estimation, deep Variational Autoencoders (VAEs) have become powerful tools for reconstruction-based Time Series Anomaly Detection (TSAD). Existing VAE-based TSAD method…
Anomaly DetectionSelf-Supervised LearningTime SeriesTime Series Anomaly DetectionPriorVAE: Encoding spatial priors with VAEs for small-area estimation
Gaussian processes (GPs), implemented through multivariate Gaussian distributions for a finite collection of data, are the most popular approach in small-area spatial statistical modelling. In this context they are used …
DecoderGaussian ProcessesTree-Augmented Cross-Modal Encoding for Complex-Query Video Retrieval
The rapid growth of user-generated videos on the Internet has intensified the need for text-based video retrieval systems. Traditional methods mainly favor the concept-based paradigm on retrieval with simple queries, whi…
RetrievalVideo RetrievalGenerating Diverse High-Resolution Images with VQ-VAE
We explore the use of Vector Quantized Variational AutoEncoder (VQ-VAE) models for large scale image generation. To this end, we scale and enhance the autoregressive priors used in VQ-VAE to generate synthetic samples of…
DecoderDiversityImage GenerationVocal Bursts Intensity PredictionGenerating Diverse High-Fidelity Images with VQ-VAE-2
We explore the use of Vector Quantized Variational AutoEncoder (VQ-VAE) models for large scale image generation. To this end, we scale and enhance the autoregressive priors used in VQ-VAE to generate synthetic samples of…
DecoderDiversityImage GenerationVocal Bursts Intensity Prediction