VQ-AR: Vector Quantized Autoregressive Probabilistic Time Series Forecasting
Time series models aim for accurate predictions of the future given the past, where the forecasts are used for important downstream tasks like business decision making. In practice, deep learning based time series models come in many forms, but at a high level learn some continuous representation of the past and use it to output point or probabilistic forecasts. In this paper, we introduce a novel autoregressive architecture, VQ-AR, which instead learns a \emph{discrete} set of representations that are used to predict the future. Extensive empirical comparison with other competitive deep learning models shows that surprisingly such a discrete set of representations gives state-of-the-art or equivalent results on a wide variety of time series datasets. We also highlight the shortcomings of this approach, explore its zero-shot generalization capabilities, and present an ablation study on the number of representations. The full source code of the method will be available at the time of publication with the hope that researchers can further investigate this important but overlooked inductive bias for the time series domain.
Code (0)
등록된 구현이 없습니다.
Tasks
Decision MakingInductive BiasProbabilistic Time Series ForecastingTime SeriesTime Series AnalysisTime Series ForecastingZero-shot GeneralizationSimilar Papers 제목 키워드 기반
Less Is More: Generating Time Series with LLaMA-Style Autoregression in Simple Factorized Latent Spaces
Generative models for multivariate time series are essential for data augmentation, simulation, and privacy preservation, yet current state-of-the-art diffusion-based approaches are slow and limited to fixed-length windo…
Data AugmentationCausal Inference in Non-linear Time-series using Deep Networks and Knockoff Counterfactuals
Estimating causal relations is vital in understanding the complex interactions in multivariate time series. Non-linear coupling of variables is one of the major challenges inaccurate estimation of cause-effect relations.…
Causal InferencecounterfactualTime SeriesTime Series AnalysisUnleashing Transformers: Parallel Token Prediction with Discrete Absorbing Diffusion for Fast High-Resolution Image Generation from Vector-Quantized Codes
Whilst diffusion probabilistic models can generate high quality image content, key limitations remain in terms of both generating high-resolution imagery and their associated high computational requirements. Recent Vecto…
Image GenerationVector Quantized Diffusion Model for Text-to-Image Synthesis
We present the vector quantized diffusion (VQ-Diffusion) model for text-to-image generation. This method is based on a vector quantized variational autoencoder (VQ-VAE) whose latent space is modeled by a conditional vari…
DenoisingImage GenerationText to Image GenerationText-to-Image GenerationAutoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecasting
In this work, we propose \texttt{TimeGrad}, an autoregressive model for multivariate probabilistic time series forecasting which samples from the data distribution at each time step by estimating its gradient. To this en…
Multivariate Time Series ForecastingProbabilistic Time Series ForecastingTime SeriesTime Series Analysis+1