paper-with-me

Papers

VQ-AR: Vector Quantized Autoregressive Probabilistic Time Series Forecasting

2022-05-31 · Kashif Rasul, Young-Jin Park, Max Nihlén Ramström, Kyung-Min Kim

Time series models aim for accurate predictions of the future given the past, where the forecasts are used for important downstream tasks like business decision making. In practice, deep learning based time series models come in many forms, but at a high level learn some continuous representation of the past and use it to output point or probabilistic forecasts. In this paper, we introduce a novel autoregressive architecture, VQ-AR, which instead learns a \emph{discrete} set of representations that are used to predict the future. Extensive empirical comparison with other competitive deep learning models shows that surprisingly such a discrete set of representations gives state-of-the-art or equivalent results on a wide variety of time series datasets. We also highlight the shortcomings of this approach, explore its zero-shot generalization capabilities, and present an ablation study on the number of representations. The full source code of the method will be available at the time of publication with the hope that researchers can further investigate this important but overlooked inductive bias for the time series domain.

📄 PDF Abstract BibTeX arXiv:2205.15894

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingInductive BiasProbabilistic Time Series ForecastingTime SeriesTime Series AnalysisTime Series ForecastingZero-shot Generalization

Similar Papers 제목 키워드 기반

Less Is More: Generating Time Series with LLaMA-Style Autoregression in Simple Factorized Latent Spaces

2025-11-07 · Siyuan Li, Yifan Sun, Lei Cheng, Lewen Wang 외 arxiv

Generative models for multivariate time series are essential for data augmentation, simulation, and privacy preservation, yet current state-of-the-art diffusion-based approaches are slow and limited to fixed-length windo…

Data Augmentation

Causal Inference in Non-linear Time-series using Deep Networks and Knockoff Counterfactuals

2021-09-22 · Wasim Ahmad, Maha Shadaydeh, Joachim Denzler

Estimating causal relations is vital in understanding the complex interactions in multivariate time series. Non-linear coupling of variables is one of the major challenges inaccurate estimation of cause-effect relations.…

Causal InferencecounterfactualTime SeriesTime Series Analysis

Unleashing Transformers: Parallel Token Prediction with Discrete Absorbing Diffusion for Fast High-Resolution Image Generation from Vector-Quantized Codes

2021-11-24 · Sam Bond-Taylor, Peter Hessey, Hiroshi Sasaki, Toby P. Breckon 외

Whilst diffusion probabilistic models can generate high quality image content, key limitations remain in terms of both generating high-resolution imagery and their associated high computational requirements. Recent Vecto…

Image Generation

Vector Quantized Diffusion Model for Text-to-Image Synthesis

2021-11-29 · CVPR 2022 1 · Shuyang Gu, Dong Chen, Jianmin Bao, Fang Wen 외

We present the vector quantized diffusion (VQ-Diffusion) model for text-to-image generation. This method is based on a vector quantized variational autoencoder (VQ-VAE) whose latent space is modeled by a conditional vari…

DenoisingImage GenerationText to Image GenerationText-to-Image Generation

Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecasting

2021-01-28 · Kashif Rasul, Calvin Seward, Ingmar Schuster, Roland Vollgraf

In this work, we propose \texttt{TimeGrad}, an autoregressive model for multivariate probabilistic time series forecasting which samples from the data distribution at each time step by estimating its gradient. To this en…

Multivariate Time Series ForecastingProbabilistic Time Series ForecastingTime SeriesTime Series Analysis+1